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ABSTRACT 

Manual flight control and emergency procedure task skill 
degradation was evaluated after time intervals of from 1 to 
t> months. The tasks were associated with a simulated launch 
through orbit insertion flight phase of a space vehicle. The 
results showed that acceptable flight control performance was 
retained for 2 months, rapidly deteriorating thereafter by a 
factor of 1.7 to 3. 1 depending on the performance measure 
used. Procedural task performance showed unacceptable 
degradation after only 1 month, and exceeded an order of 
magnitude after 4 months. The effectiveness of static re- 
hearsal (checklists and briefings) and dynamic warmup (sim- 
ulator practice) retraining methods were compared for the 
two tasks. In general, static rehearsal effectively countered 
procedural skill degradation while some combination of dy- ' 
.namic warmup appeared necessary for flight control skill 
retention. Further, it was apparent that these differences 
between methods were not solely a function of task type or 
retraining method, but were a function of the performance 
measures used for each task. 
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FOREWORD 


This report summarizes an experimental study accomplished as 
the second part of a program designed to investigate the degradation 
of learned skills as applicable to spaceflight tasks. The research 
reported here was begun in July 1970 and was completed in May 1 ‘ * 7 1 
for the NASA Manned Spacecraft Center under Contract NASh-10962. 

The study was initiated by Mr. Earl LaFevers of the Crew Systems 
Division as NASA Project Monitor, and was then transferred to Dr. 
William E. Fedderson, Chief of the E^ehavioral Laboratory, Bio- 
medical Laboratories Division, who was Project Monitor to comple- 
tion. 

The Boeing Program Manager was Dr. George D. Greer, Jr. and 
the Principal Investigator was Dr. Thomas E. Sitterley. 1 he authors 
gratefully acknowledge the extensive assistance of Mr. Gale M. Rhoades 
wno provided simulator modification, operation, experimental testing, 
and data reduction throughout the course of this study. 

The first part of this investigation of degradation of learned skills 
was covered in Report D1 80- 1 5080 - 1 , Degradation of Learned Skills 
- A Review and Annotated Bibliography'. 
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1. introduction 


The rucirhI ind safety of anv flight missier is dep*- • den? ipo -’ol on I 
rhe design md mechanical integrity oi the flight ve* hie, t*u» Iso to 
very great «*xi* nt upo" t’e capability me preparedness of tire pilot. Witr 
the arlv< nt of manned sp.*< * fligdt, t e dem v «i* plated up<» t;-*- agtror ut’« 
a foil it < to perform hi* t-isk* b ave been ex! r«ord»*..> r> . The demand* •> 
the abilities of istron >i!*c to provide mnuit im.troi liner e??i on i> hot! 
normal and erne modet of operation b -s paralleled « .he *ig ihc- nt 

increases in mission compl it y and duration. During tin* p* r .od o' p, - r 
increasing mission cotnplev tv, the opportunity tor *<viiprn< r*t * ilv- f • 
likewise Increased dramatically. The «*u t e s - of mam missions a d more 
than once the 1 1 v *? •* of the crew were saved only tut *ug the t^tro its' 
skills and thorough training. 

Current Apollo flight < r*'W training for lun-ti Un-ding m*- o s i- illi sir 
tivr of t h«* type of training necessary to ensure mission suit ess, Alter 
being selected, the astronaut groups spend * pproximate lv l#n<-r<M In 
i generil flight training program which includes detailed u riel 

ing on ail spacecraft systems, environmental famtliari* Dio i vn 
\ lval training. After completing the I H month training pro^r m, ti * a 
»:rcw member i» ready for assignmei t to flight a.nulm or to «p- c i ♦ i 
mission training. In the case of the lunar landing missicn t W training 
adds up to a total of approximately «i^00 hours, scheduled ovrr 44 w«t'« 
period (Slayton 19t>7). The integration and scheduling of thin training 
must be carefully planned because of the vast number nt tasks to be 
learned over the multi-year training program. Throughout He program, 
previously learned mission elements must be systematic ally reviewed 
in order that the skills are not forgotten at the completion of training. 
lAiring the course of mission training, literally hundreds of hours are 
spent in practicing the required mission skills on highly sopi istlcated, 
igh fidelity spacecraft simulators. 

In this and future decades, spacecraft with even longer, more complex 
flights will be developed. Many will be a significant dep rturo from 
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previous missions, having greater autonoin . from ground based v 
• rol, an< a' ith flight control i far more complex than fvjr befor* 1 . 

Spate station* with, i issions ol one ye* r or more, and manned inter- 
planetary flight* wit.i m. salons of two years .ind longer will be possible, 
n.t* gre -ter complexity and duration ol these future «p»ce explorations 
wii! mak» < stronant performance all the more criti. »l to over 11 mi- 
■ ion. success and safety. 

i s t experience indicates that the probability of catastrophic failure la 
increased substanti Uy If high performance in skill retention is not ef- 
fectively maintained over long durations of task inactivity, however, 

’he benefits of months of continuous training on the ground and in stinu- 
1 tor** will no longer be available to the astronauts on these long duration 
missions. A system of onboard rcfreshei training will be required to 
. mi .tain the criti*. vl flight, procedural, and operational skills of the 
astronauts. 

H • co figuration of thi* training system could involve a broad range ot 
■ibele mrnt complexities depending on the nature and type of astronaut 
»s** . '» • tii i* since last t-.sk performance, and the degree of original 
t- .ii' i ig, or overtraining. 1'he least complex subelement might be noth- 
ing more than .< review of verbal and pictorial briefing aids similar to 
ti ose found In current checklist and flight operations manuals. A mid- 
dle level ot complexity could involve the ns« of simulation softwtre within 
tl < spa*, e craft com put rs to operate onboard equipment in a training mode. 
Beyond thlr» may b< the application ol more sophisticated combinations 
ot software, computers, and simulation/t raining hardware to provide 
i ig! fidelity reproduction ot spacecraft syst-rn dynamics and the opera- 
tion il vi«u 1 environment issociated with critical mission operations, 
phases, and maneuvers. 

11< impact of providing onboard training dictates that training require- 
ments be carefully assessed so that efficient, coat effective systems 
can be designed. Each increase in the level of onboard training system 
ompl*'\ity will be accompanied by a corresponding increase in the de- 
mands placed upon th<- limited volumetric space, weight and electrical 
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pow»- r c*pAcifrif»S of the %p j . c**c t sft Ih# syetem mu*' provide mer*--- 

for*, cnt- m f «d*< i/l- *vpf , .»rd fidelity c*t training *h-* will 

satisfy H ir gu*i* »f nlftitm safety, reliability, ’mi lunM^A. 
w- » ik ii wt i fjt 1 # more cUIwuUl or « ample* i k m reu-oired to satis! 
these <o«i» without c dmproml *• i«* no* only wasteful oi r-n r **, trui 
may also compromise the p«te t:4« 4 of mission obis . mv*>x 

A serlou* problem faring system* designers, *h»r>, is the prrtist spe- 
cification of lhp astronaut fatks and shill* which *re sublet* to degra- 
dation, the interval of time <?inte* last pr - ‘ice which will resiil* in <»ifc- 
nlfican! degr* iatitm, * d ’he id* ratification of thus* parameters which 
ten he e\ pitted to rethio or modify the nature perform: * d- g r t 

dation. He- og nit ion that the forgetting of l- ined «f>Hs r. produce 
major consequences atfecting overall su- easeful performance i« • ot 
new. Poth the human p* rformance literature and pet-eon il expe rience 
confirm that forgetting is basic to human behavior. 

The problem of srill retention 1 b complex, liowever, and t! e 'evmw 
ot both rpe t ation-illy oriented and cl isaical e '.peri me t il literature on 
skill retention reveals a variety of conflicting data. Skill retention t.*n 
be affected by • gre •* numbsi of independent v»ri blca »nd conditions. 
Fortunately over hLM’ \ c-.»r •» of literature concerned wit.’ 'he lo- g tern 
retention ot skill performance was reviewed by Naylor ana Briggs f ) 9‘ 1) 
who provided both important conclusions and gener-.l org «ni/ tioi for 
variables which had been examined. U^ing their reviews •» • back- 
ground against which the more recent literature covild be compared "id 
assessed, Gardlin and Sitterley (197 <!) provided an overview o' the mors 
recent literature which could be related to piloting art space ‘light t '*ks. 
Four basic categoriea or parameters wliich affect skill retention ha-, e 
been highlighted in the literature: a) tutk environment <nd task type or 
organization, b) amount and type ol original training, c) the length 
of the retention interval, and d) the type of Interim practice. 

Three general types of tasks have been highlighted in the classical it- 
erature: verbal (cognitive' discrete psycnomotor and continuous psy- 

chomotor. In evaluating the relationship between tasks characterized 
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lOnU'.uoas (tracking) and discrete or sequential (procedural tasks), 
i lor i, rj F'riggs (1961) indicated that continuous tasks are retained 
• « .*•!. 1 ey pointed out that this finding was somewhat superficial, 

uwr.u, lince the primary difference between tasks requiring discrete 
d cor.f r nous responses was largely a question of organization. Typ- 
il t he procedur 1 task h 'S less spatial or tempor 1 organization 
does the tracking task. While useful from the standpoint of task 
riptlon, the procedural task/continuous control task dichotomiza- 
rio* if t <■ literature can lead to incorrect prediction of the retention of 
ills. 1'iloting an aircraft, while primarily psychomotor in na- 
t-. . requires a significant cognitive contribution in terms of informa- 

t .oi integratior and decision making. The cognitive, discrete, and 
o tmuovis control task elements are often represented to varying de - 
the tligiit control task. The effects of these elements on total 
task performance must be defined, with the prediction of skill retention 
■ los •• 1 . tied to the defined measures of task performance. 

the most st r.iightforward generalizations such as "the higher the 
: itial level oi performance at the end of training the lower the perfor- 
ce i it' degradation" or "the longer the period between training and sub- 
fieque; t performance the greater the performance degradation" are not 
■. o: isto tT supported. Much of the conflict in the literature apparently 

0 «’ir- because many studies, directed toward the same question, use 
*.v . d’ 1. di ergent tasks, performance criteria, and subject populations. 

r t i . il riy criti T here re che task characteristics and spe c\i ication 
o: performance criteria; however, when care is used in defining .he 
t pc of task ..n apparent superiority in skill retention is found for con- 
tinuous control t sks s opposed to procedural tasks. Likewise, within 
t ;*k typ* botn final tr lining acquisition performance and initial re - 
tention performance vary posiii%-eLy with the amount of training. 

1 * duration of tne retention interval has considerable validity as an 
influential variable: the longer the retention interval the greater the 
>kiU loss. However, the amount of skill degradation appears to be 
highly t..sk specific. While continuous control tasks appear to be re- 
tained best, very few studies have systematically evaluated skill retention 
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for both procedural and continuous control tasks over a broad range of 
skill retention intervals while keeping task conditions constant. Gen- 
erally, the effects of task rehearsal or warmup practice mitigate the 
skill loss usually associated with a no practice interval of time. The 
importance of practice has been shown to be greater for retention in- 
tervals of longer durations. Further, the relative benefits of the same 
amount of practice are greater for procedural tasks as compared to 
continuous control tasks. There are, however, conflicts in the litera- 
ture which appear to stem from the fact that insufficient data have been 
systematically collected to evaluate the type of practice most suitable 
for procedural and continuous control tasks over a sufficiently wide range 
of retention intervals. 

Purpose 

Both operational experience and the experimental literature, its incon- 
sistencies notwithstanding, indicate that skill retention in future com- 
plex and long duration space missions will be a problem. It is also 
known that retraining techniques can be effective in countering the ef- 
fects of time and interference on skill degradation; however, neither 
experience nor the literature specify, other than in a very general fashion, 
the time based quantitative degradation of spaceflight skills or the specific 
rehearsal or warmup techniques that will effectively counter that degra- 
dation in a consistent and systematic fashion. 

Using a spacecraft simulator and relatively operationally oriented tasks, 
the purpose of this study was: a) to determine whether skill degradation 
of the simulated tasks was indeed significant and what interval of time 
without rehearsal or warmup was critical for skill retention; b) to 
investigate the effectiveness of static rehearsal and dynamic warmup 
for procedural and continuous control tasks; and c) to determine the 
relationship between performance criteria and the type of practice best 
suited for the tasks. 
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2. METHOD 

A series of tests using a total of 45 subjects was conducted to measure 
skill retention on continuous control and procedural tasks. The primary 
task involved manual control of a reusable space vehicle during the boost 
phase. Time intervals were covered ranging from 1 to o months, and 
conditions investigated included: no practice, immediate rehearsal, 
distributed rehearsal, warmup and combinations of immediate and dis- 
tributed rehearsal with warmup. Rehearsal involved the use of visual 
briefing materials, oral review and written testing prior to the simu- 
lated booster flight. Wnrmup involved repeating the actual flight in the 
test simulator. Table 1 summarizes the test conditions and time inter- 
vals investigated. 


Table 1: Retention Practice Conditions by Subject Group 


SUBJECT GROUP 

RETENTION PRACTICE CONDITIONS 

TIME INTERVAL 

L ... _ 

1 

NO-PRACTICE 

1 MO 


IMMEDIATE WARMUP 

1 MO 


DISTRIBUTED WARMUP 

3 MOS 

2 

NO-PRACTICE 

2 MOS 


IMMEDIATE WARMUP 

2 MOS 

3 

NO-PRACTICE 

3 MOS 


IMMEDIATE WARMUP 

3 MOS 

4 

NO-PRACTICE 

4 MOS 


IMMEDIATE WARMUP 

4 MOS 

5 

NO-PRACTICE 

6 MOS 

* 

IMMEDIATE WARMUP 

6 MOS 

6R 

IMMEDIATE REHEARSAL 

3 MOS 


REHEARSAL + WARMUP 

3 MOS 

7R 

DISTRIBUTED REHEARSAL 

3 MOS 


DISTRIBUTED REHEARSAL + WARMUP 

3 MOS 

8P 

IMMEDIATE REHEARSAL 

6 MOS 


REHEARSAL + WARMUP 

6 MOS 

9R 

DISTRIBUTED REHEARSAL 

6 MOS 


DISTRIBUTED REHEARSAL + WARMUP 

_J 

e mos 


The subjects were randomly assigned to one of 9 test groups (5 subjects 
to a group). They were then systematically trained until they performed 
at a level equivalent to a specified qualification criteria. Depending upon 
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the group assignment, the subjects were scheduled for testing, or re- 
hearsal and eventual testing, at the specified intervals. Performance 
data were collected and compared to the qualification data to determine 
the degree of skill retention and the effects of the various skill reten- 
tion practice methods. 


Subje cts 

For this investigation it was determined that relatively naive subjects 
could provide the required data more cost effectively than highly trained 
test pilot subjects. Previous investigations at Boeing have indicated 
that non-pilot subjects can he trained to perform specific space ve- 
hicle control tasks at a level of performance comparable to trained 
pilots, if the subjects did not approach task load limits, and if adequate 
part-task training was provided. The subjects required about 5 times 
as much training as pilots on the same control task, but to train and 
test 45 skilled astronauts or operational pilots and limit their exposure 
to space flight and aircraft flight training tasks for periods of 1 to 6 
months was an operationally impossible situation even if cost was not 
conside red. 

The subject population met the following requirements: 

1. College degree 

2. Age under 50 

3. Vision 20/20 corrected 

4. Commitment to no flight activities 
during the test period 

The test subjects were selected from a voluntary population of available 
Boeing personnel. All subjects were engineers or scientists within the 
engineering or technical staffs. Professional backgrounds were varied, 
ranging from aerodynamic performance and control system engineers 
to research scientists. Forty-five subjects were required for the 
experiment. Five additional subjects did not complete training for 
either scheduling or vision reasons. 

Test subject ages ranged from 23 to 50 with a mean of 35. The age 
standard deviation was d . 6 years. Of the 45-man group, 21 subjects 
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had 20/20 vision uncorrected and 21 subjects had 20/20 vision corrected. 
Three subjects had less than 20/20 vision: 1-20/40 corrected; 1-20/30 

corrected; 1 -20/25 uncorrected. An examination of tneir data revealed 
no significant differences from the remaining members of their groups. 

Thirty-five of the 45 tested subjects had no previous flight control ex- 
perience. Eight out of the remaining ten subjects had less than 140 hours 
in light aircraft and none of these eight had flown since 1968. Two out 
of the ten experienced subjects had significant military flight control ex- 
perience during the Korean War and earlier. One subject had 3700 hours 
in military transport reciprocating engine aircraft. The other experienced 
subject had 1600 hours primarily in light observation aircraft and 3200 
hours in rotary wing aircraft. None of the test subjects controlled an 
aircraft during the duration of the test. 

Task Description 

The primary task involved manual control of a reusable spaceflight ve- 
hicle during the phase from lift-off to orbit insertion. Subject perfor- 
mance was measured on two subtasks: a continuous control task, and 
a procedure task. Continuous control data were taken independently of 
the procedure task data. Procedure task data were taken while the sub- 
jects were performing the continuous control task; however, the pro- 
cedure task was designed to isolate continuous control task loading 
effects from the procedure task data. 

C ontinuous Control Task 

The continuous control task required the subject to manually control a 
stabilized space vehicle from launch to orbit. A summary of the vehicle 
characteristics and orbit insertion parameters is presented in Table 2. 

The subject was required to scan displays, compare the displayed data 
in a time reference with the trajectory guidance card, and provide con- 
trol inputs to fly the optimum trajectory. The total ascent profile re- 
quired o minutes, 44 seconds to complete. 
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Table 2: Summary of Simulation Vehicle and Orb i l Insertion Characteristic 


BOOSTER 

STAGE WEIGHT 

2,722,000 LB 

USEFUL PROPELLANT 

2,220,000 LB 

VACUUM THRUST (TOTAL) 

4,840,000 LB 

SPECIFIC IMPULSE (VAC) 

440.4 SEC 

i 

ORBITER 

IGNITION WEIGHT 

778,000 LB 

PROPELLANT CONSUMED TO INJECTION 

516,936 LB 

VACUUM THRUST 

1,392,600 LB 

SPECIFIC IMPULSE (VAC) 

464.9 SEC 

INSERTION CONDITIONS 

TIME 

404 SEC 

VELOCITY (RELATIVE) 

25,029 EPS 

ALTITUDE 

273,000 FT 

FLIGHT PATH ANGLE 

CO 

TVJ 

C 

INCLINATION 

54 8° 

RANGE FROM LAUNCH SITE 

592 N Ml 


The display panel appears in Figure 1. Displayed information includes 
mission time, altitude, altitude rate, altitude error, angle of attack, 
velocity, vehicle pitch and roll error, side slip, and compass heading 
error, The vehicle pitch and roll error were displayed on an early 
model Attitude Director Indicator (ADI). This ADI was installed in 
several models of the Boeing 707 commercial jet aircraft. The alti- 
tude error was displayed on a CRT. Remaining information was dis- 
played on vertical or horizontal scaie electromechanical instruments. 
The recommended procedure for flying the boost profile is described 
in the training data package (rehearsal information package) contained 
in the Appendix. 
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The following parameters were recorded for analysis of suhject per- 
formance: altitude error and altitude rate error at orbit insertion; 

total integrated pitch error and total integrated altitude error. The 
following definitions apply: 

Altitude error - The error in feet from the 
desired altitude of 271,000 feet at 
orbit insertion (the end of the manually 
controlled boost phase). 

Altitude rate erro r - The error in feet per second 
from the desired altitude rate of change 
of +140 ft/sec at orbit insertion. 

Total integrated pitch er ror - l'he absolute pitch 
error from the nominal pitch profile 
integrated over the duration of the total 
manually controlled flight, measured 
in degree-seconds. 

Total integrated altitude error - The absolute 

altitude error from the nominal altitude 
profile integrated over the duration, of 
the total manually controlled flight, 
measured in foot-seconds. 


Procedure Task 

An "emergency" occurring in the Attitude Indicator System formed the 
basis for the procedure task. The task required the subject to respond 
to a failure indication and make a series of decisions based on sequen- 
tially requested information displayed on a meter. The procedural task 
display and control panel, shown in Figure 2, was located in the upper 
left quadrant of the cockpit. 

The subject was required to start the procedural task while he was 
actively engaged in the continuous control task (manual control of the 
vehicle ascent trajectory). Within the first 2 minutes of the ascent, 
an "Attitude Indicator Failure" light was illuminated by the procedure 
task operator (experimenter). The subject responded by actuating the 
"Auto Control" pushbutton which put the simulator on automatic control 
and relieved the operator from the control task. This effectively sepa- 
rated the two tasks and eliminated experimental data interference. The 
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Figure ?: Procedural Task Uisplav/Control I’.im-l 


subject next actuated the "Attitude System Check" pushbutton which, 
caused a meter to read one of three numbers: 0.7 5, 1.0, or 1.5. 

Based upon the meter reading, the subject had to decide which oi three 
control sequences to follow as indicattd in the logic diagram (Figure 3). 

The three indications were: system O. K. (1. 5), system failure (0.7 5), 
or meter reading is inconclusive (1.0). If the system was C. K. (1. 5), 
the subject actuated "Manual Control" and continued manually controlled 
flight. If a failure was indicated ( 0 . 75 ), the subject actuated the "Atti- 
tude Alternate" control and was required to run another system check. 

At this point another meter indication was programmed which led to 
continuing the flight in auto or returning the system to manual control. 

If the meter reading was inconclusive (1.0), the subject was required 
to recheck before proceeding into another control sequence branch of 
the logic diagram. Whenever the subject took an action that was out of 
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Figure 5 : 


Procedure Tank. I.OJ41C Flow Diagram 
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■ programmed seque : ce, . ‘Overload Indicator ' came on and had to 
be aetu.it* ri before restarting the proper sequence. 


Performance data was automatically recorded for the following para- 
meter-: initial response time, decision time, sequence time, total time 

decision, sequence and total errors. The following definitions . . pply : 


Initial Response Time - Time measured from initiation of 

test to actuation of Auto Control 
Button (first subject action). 


Decision Time - 


Sequence Time - 


Total Time 


Decision Lrror - 


Sequence Lrror - 


Time measured from initiation of 
System Check button to actuation 
of next appropriate button (meas- 
ures time to read meter, decide 
and take appropriate iction). 

Time measured between sequential 
button actuations: Auto Control 
to System Check and Alternate 
Attitude Systems to System Check. 

Time measured from initiation of 
test until actuation of last button 
in the test sequence. 

Actuation ot the wrong button fol- 
lowing ictu tio of the System Check 
button (meter reading). 

Actuation of uiy out of sequence 
button with the exception ot deci- 
sion errors. 


Total Lrrors - 


Summation of decision and sequence 

e r rors. 


Lquipme n t 


‘he experimental test was conducted in the Boeing Human Performance 
Muitist re s * l aboratory located in Kent, Washington. 1 he facility Is 
or i ally used to evaluate crew performance under individual or com- 
bin.cd environmental strokes which may include vibration, temperature, 
pre sure, humidity, noise, and various atmospheric gas compositions. 
Ii.*T \: alt 1st re x » Laboratory Is connected to a visual display generating 
facility d a major computing system ir which six large general purpose 
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analog computers and two general purpose digit T computers re com- 
bined with a full complement of supporting input /output display nd re- 
cording equipment. 

The simulation laboratory is depicted in Figure 4. fhe laboratory is 
composed of computer interface equipment, display /control and task 
programming equipment, test operation and experimenter's control con- 
soles, and a subject test chamber. The test chamber, desi ned for 
environmental stress testing, provides a 100 cu ft cockpit area. The 
pilot's chair is mounted on the chamber door which is rolled closed on 
rails. Figure 5 depicts the entrance to the test chamber with a subject 
prior to a test run. The three-axis side arm controller was mounted 
on the right arm of the pilot's seat. The cockpit displays and remaining 
controls were mounted on the end bulkhead of the test chamber (Figure 
6 ). 


; 



Figure 4: Simulation Laboratory 
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C onti nuous Control Tas k 

The dynamic flight characteristics of the simulated reusable space ve - 
hide were derived from early Boeing Space Shuttle studies. Two analog 
computers were used to simulate the flight characteristics using a point- 
nass simulation model. During the training ol the first 22 subjects, a 
Beckman EASE 2100 mu log computer provided dynamic flight character- 
istics and the required data collection functions. Because of better avail- 
ability and improved operational arrangements, the EASE 2100 simula- 
tion was transferred to the Applied Dynamics 256 solid state analog com- 
puter. The AD 256 was used for the remainder of the experiment, r.nd 
t lie EASE 2100 was kept available as a backup computer. 



Figure 7: Schematic of Flight Simulator Model 
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A summary flow diagram of the flight simulation model appears in Fig- 
ure 7. Stick inputs to the stability augmented fligl.t control system 
developed Euler rates (rotational velocities about the vehicle axes). The 
Euler rates were then Integrated to produce Euler angles. Using the 
l uler transfoi nation process, the Euler angles were combined with 
translational ’ elocities and transformed into body axis velocities (U , 

W^, V r ) which were resolved into angle of attack (a ), and angle of 
slideslip ( £ ), and total velocity (V^). All velocities were relative to 
the point of launch. Alpha and Beta were displayed and monitored in 
the data recording system. Thrust was generated as a function of time 
and altitude was automatically terminated when total velocity was opti- 
mum. Li the next operation, thrust, gravity and centrifugal forces 
were resolved into horizontal, lateral and downward components. The 
force components were then converted into velocity components which 
were displayed and monitored for data. Tne velocity components were 
also fed ipto the Uuler transformation process. Altitude rate was in- 
tegrated and an altitude signal returned to the thrust function generator. 

The control stick was a 3-axis, sidearm controller developed from an 
Air Force design originally evaluated for use in the Aerospace Astro- 
naut Training Program at Edwards AFB. The stick provided 'rate" 
inputs as a linear function of angular displacement and stick force. 

Stick sensitivity data appears in Table 3. 


Table 3: Three Axis Control Stick Characteristics 



RANGE 

SENSITIVITY 


FORCE 

LOCATION 
AND TYPE 

CONTROLLER PITCH 

10.5° 

0.332 e /S/ c 

LINEAR 

1.5 

3 LB 

SIDE ARM 

CONTROLLER ROLL 

12° 

0.0415°/S/° 

LINEAR 

1.5 

3 LB 

SIDE ARM 

CONTROLLER YAW 

21° 

0.420 # /S/ 0 

LINEAR 

2 

5 LB 

SIDE ARM 
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The flight instrumentation is shown in Figure 1. A description of each 
instrument and the recommended flight control procedures appear in 
the Appendix. Display readability and sensitivity parameters appear in 
Table 4. 


Table 4: Flight Instrument Sensitivity and Readability Parameters 


CONTROL/INDICATOR 

RANGE 

SENSITIVITY 

DIVISIONS 

FACE SIZE 

TYPE 

ALTITUDE, H 

0- 100 K 

2.0007DIV 

50 

4 Vi x 1 v, 

VERTICAL 

ALTITUDE RATE, H 

-5- + 20 x 1 00 

507SEC/DIV 

50 

4% x 17 

VERTICAL 

ANGLE OF ATTACK, a 

25° - 0 - 25° 

1°/DI V 

50 

4Vi x r/ 3 

VERTICAL 

AIR SPEED 

0-25 K 

5007SF.C/DIV 

50 

4h x r/j 

VERTICAL 

SIDE SLIP 

±15° 

1°/DI V 

30 

2'/i" x y 2 

HORIZONTAL 

COMPASS HEADING 

±10° 

0.4°/DIV 

50 

2V' DlAM 

STANDARD 

HDI PITCH ERROR 

±2.15° 


4 

3-5/8” DlAM 

STANDARD 

HDI ROLL ERROR 

360° 


6 

3-5/8” DlAM 

STANDARD 

ALTITUDE ERROR. AH 

18,000' 

4.0007DIV 

4 

5 Vi" DlAM 

STANDARD 

CLOCK 

8 DAY 

I’VDIV 

60 

2" DlAM 

STANDARD 


Pr ocedure Tas k 

The Procedure Task Function Logic System (PTFLS) formed the basis 
of the procedure task equipment. This equipment was composed pri- 
marily of logic gate and flip flop circuits designed to drive the pro- 
cedure task displays and measure operator sequential response and 
response tir .e performance. The Attitude Indicator System failure 
operation was programmed to operate according to the procedure task 
logic. The task displays and controLs were mounted on the upper 
left quadrant of the cockpit instrument panel. 

The PTFLS data were recorded as analog signals on FM magnetic tape. 
The PTFLS also operated a digital clock readout display on the experi- 
menter's control panel which Indicated total task response time for 


19 









D180-15081-1 


immediate evaluation by the test operator. A hybrid computer program 
for an XDS 9300 digital computer and an EASE 2100 analog computer, 
was used to convert the data from FM magnetic tape to digital mag- 
netic tape and to provide data analysis and reduction. The EASE was 
scaled to ser.se signal level changes, converting the signals to inter- 
rupt functions which were fed directly to the XDS 9300 digital computer. 
This computer processed the digital interrupt signals in conjunction 
with a program that produced a compilation of addressed data files 
suitable for analytical processing. Tire 9300 stored the addressed data 
files on magnetic tape which then were processed through one of six 
analysis subroutines to obtain the desired performance data. 

Test Operator Station 

The test operator's station included the continuous control task and 
procedure task control panels, a Frieden Flexowriter, an X-Y plotter, 
a remote control panel for an Ampex FR 100/1300 tape recorder and an 
electronic calculator. The flexowriter, X-Y plotter and the calculator 
supported data collection and preliminary analysis of the continuous 
control task data. The Ampex tape recorder was used to record pro- 
cedure task FM signal data. 

Subject Training 
Continuous Control Training 

The subject training procedure was standardized. Each subject received 
a basic lecture corresponding to the training data package that is con- 
Lained in the Appendix. This data package also served as the rehearsal 
information package. Following the lecture, the subject was seated in 
the cockpit an i familiarized with the operational instruments, indica- 
tors and flight initiation procedures. Each instrument and its scale 
factor was reviewed with the subject. 

The subject was then instructed to observe the instruments while the 
simulator flew 2 automatic runs ett 10 times real time. This familiarized 
the subject with the working characteristics of the displays and demon- 
strated the ranges displayed on each instrument. The subject then 
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observed a real time automatic run and was instructed on the desired 
instrument scan pattern and encouraged to check the automatically 
flown profile against the flight profile card. At this time the subject 
started his first manually controlled flight. The instructor observed 
and "talked" the subject through the first three training flights. The 
subject continued to fly in sets of 5 flights until his average perfor- 
mance for 5 consecutive flights met the following training qualification 
test performance criteria: 

Altitude 

Mean — 1500' Standard Deviation: 2000 ft 

Altitude Rate 

Mean + 50 ft/ sec Standard Deviation: 60 ft/ sec 

Integrated a Alt. 

Total < 700, 000 ft/sec 

Integrated h Pitch 

"Total < 465 deg-sec 

Pr ocedure Training 

The standard training procedure in this task was to give the subject 
a lecture on the procedure task using the material in the Appendix. 
Next, the subject was seated in the cockpit and the procedure was 
demonstrated using the actual input controls and displays. The sub- 
ject was then presented with 5 sets of the 14 different procedures in 
random sequence, and 2 sets of 5 specific procedures in a specified 
sequence. Table 5 illustrates the meter readings at each decision 
point for the 14 procedure combinations used in training. The five 
test procedures are also indicated with their test sequence. During 
the training period the subject was permitted to refer to the pro- 
cedural flow diagram (Figure 3). 

At the next session, the subject received training in the same manner. 
If the subject's total time for each procedure stabilized (was not con- 
tinuing downward significantly) at the end of the fifth set of procedures, 
the next 2 sets of the 5 specified procedures were given as a test. If 
the subject made an error during the last set of 5, the same set was 
repeated until no errors occurred since the qualification criteria was: 
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Table 5: Procedure Task Decision Point Sequences 


PROCEDURE 

NUMBER 

" 

DECISION POINT METER READING 

COMPUTER 
MODE AT 
COMPLETION 

i 

2 

3 

4 

1 

*4 

1.5 

NA 

1 

NA 

NA 

MANUAL 

2 

*5 

0.75 

NA 

1.5 

NA 

MANUAL 

3 


1.0 

1.0 

NA 

NA 

AUTO 

4 

*1 

1.0 

0.75 

1.0 

1.5 

MANUAL 

5 


1.0 

0.75 

1.0 

1.0 

AUTO 

6 


0 

NA 

NA 

NA 

AUTO 

7 

*3 

1.0 

0.75 

1.0 

0.75 

AUTO 

3 

*2 

0.75 

NA 

1.0 

1.0 


9 


1.0 

,.6 

NA 

NA 


10 


0.75 

NA 

0.75 

NA 


11 


1.0 

0.75 

1.5 

NA 


12 


0.75 

NA 

1.0 

1.5 

MANUAL 

13 


1.0 

0.75 

0.75 

NA 

AUTO 

14 



0 75 

NA 



1.0 

L_ 

0.75 

AUTO 


’SEQUENCE OF TEST PROCEDURES 


1. Subject's total time per procedure must have stabilized. 

2. No errors permitted in the test run (last 5 procedures). 

If the subject's times had not stabilized at the end of the second session, 
additional sessions were conducted until the qualification criteria was 
achieved. 

Thirty-seven of the 4 5 subjects qualified on the procedure task in two 
sessions. The remaining 8 subjects qualified in 3 sessions. Two of 
the 6-month test groups (Groups 5 and 8R, a total of 10 subjects) were 
qualified and tested in a no-flight mode; that is, they were not required 
to fly the continuous control task while performing the procedure task. 
This deviation was necessary with the first two groups because they 
had previously qualified cn the continuous control task (before the 
procedure task was operational) in order to meet the o month interval 
contractual obligation. The continuous control task experiment would 
have been jeopardized if these groups had an opportunity to perform the 
continuous control task between the date of qualification and the date of 
te slung . 
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Group Training Performance Equivalenc e 

A total of eight months were required to complete the training of the 
nine groups of test subjects on both the continuous control and pro- 
cedure tasks. The 45 subjects who completed training flew a total of 
1, 547 boost profiles for the continuous control task, averaging 34.4 
flights to qualification (range: 13 to b8). For the procedure task, a 
total of 8,410 trials were completed by the test subjects for an average 
of 186.9 trials to qualification (range: 160 to 240). 

These subjects were randomly assigned to the nine retention practice 
conditions and sequentially trained. Training commenced first with 
the subjects in the 6-month retention interval groups and progressed 
to the shorter interval groups. By the time 60 percent of the subjects 
had completed training, the first subjects in the long retention interval 
groups were ready for final testing. Because of the time required to 
train each subject on both tasks, and the number and duration of the 
retention intervals under examination, it was not possible to match 
each of the nine treatment groups on the basis of training qualification 
performance. 

In order to determine the extent of any qualification performance dif- 
ferences between the treatment groups, and to assess the possible im- 
pact on tha interpretation of the retention test results, a series of be- 
tween group analyses were performed on the qualification performance 
data for both tasks. These analyses involved the application of the 
analysis of variance (ANOVA) statistic to the number of flights or 
trials to qualification and to each of the dependent performance measures 
for the two tasks. For the three significant dif'erences found, the data 
were further evaluated using Duncan’s New Multiple Range Test. 

The number of training flights to qualification on the continuous con- 
trol task was subjected to the A NOVA to determine if the groups dif- 
fered significantly in terms of the amount of training received. No 
practical or significant differences across the nine groups was found. 

The analysis of the number of trials to qualification on the procedure 
task was likewise found to show no significant differences between the 
nine groups. 
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A total of eight ANOVA's were performed on the data and variance of 
the four continuous control dependent variables: altitude error and 

altitude rate error at cutoff, and integrated altitude and pitch error. 

Only the ANOVA's of integrated pitch error and altitude rate error 
variance revealed significant group differences. 1 able 6 depicts a 
summary of the significant analyses of the qualification performance. 

It can be seen that, for both continuous control performance measures, 
the Duncan's test revealed overlapping sets of groups with no signifi- 
cant performance differences, l or integrated pitch error, perfor- 
mance group 6R was significantly better than group 5 and groups 3 and 
7K were significantly better than groups 8R, Z, 4, 9R and 5. All other 
combinations of groups fail to reveal significant differences. The re- 
sults of the Duncan's test for altitude error variance indicated that 
group tjR was less variable than group Z, and group 7 less than groups 
8R, 4, and Z. 

Analysis of the precedure task qualification performance measures was 
limited to the four time measures: initial response time, decision 
time, sequence, time and total response time. No analyses of errors 
were made because the qualification criteria required that no errors 
be committed during training qualification performance testing. The 
only significant group differences detected by the A NOVA were for 
initial response time. The summary of this result ai d the associated 
Duncan's test results are also included in Table 6. Once again a series 
of overlapping sets of groups with no significant performance differences 
were identified by Duncan's test. Specific group differences are sum- 
marized as follows: The performance of groups 4 and 3 was signif- 

icantly faster than group Z; group 5 performance was faster than 
groups 1 and Z; and group 8R was faster than groups 6R, 9R, 7R, 1 
and Z. All other combinations of groups did not reveal any perfor- 
mance differences in term.-, of initial response time. 
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Table 6: Training qualification Test Performance — Summary of Significant 
between Group Differences 


DEPENDENT 

VARIABLE 

ANALYSIS OF 
VARIANCE 

DUNCAN'S TEST* 
(<0.05 BY GROUP 
NUMBER) 

INTEGRATED PITCH 
ERROR 

(CONTINUOUS CONTROL) 

<0.01 

(F - 3.380, 8 
AND 36 elf) 

3 7R 6R 1 • 8R • 2 4 9R • 5 

ALTITUDE RATE 
ERROR VARIANCE 
(CONTINUOUS CONTROL) 

< 0.05 
(F 2.326. 8 
AND 36 dt) 

7R • 6R • 1 • 3 • 5 • 9R 8R • 4 ■ 2 

INITIAL RESPONSE 
TIME 

■PROCEDURE TASK) 

<0.01 

(F = 3.408. 8 
AND 36 dt) 

8R 5 ■ 4 3 6R 9R • 7R • 1 2 


'ANY TREATMENT GROUPS UNDERSCORED BY THE SAME LINE ARE NOT 
SIGNIFICANTLY DIFFERENT 


The general conclusion to be obtained from the analysis of the subject's 
qualification data was that the nine treatment groups were very com- 
parable in terms of their performance. Of the 17 measures of training 
equivalence for both tasks, only three showed any r significant group 
differences. The widespread overlapping of sets of groups with no per- 
formance differences further reduced the overall impact of the three 
significant differences found. The relationship of the overlapping group 
sets to the experimental designs used to evaluate retention interval per- 
formance revealed that, to a very great extent, the group sets associa- 
ted with a particular experimental design showed little or no performance 
differences. 

Retention Interval Refresher Training 

The 45 test subjects were divided into nine 5-subject groups to measure 
the effects of time on skill retention and to assess the effectiveness of 
two types of refresher training: static rehearsal practice and dynamic 

warmup practice. The group assignment to retention intervals and 
refresher training conditions are depicted in Table 7. 
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Table 7: Group Assignment to Retention Intervals and 

Refresher Training Conditions 


SUBJECT 

GROUP 

LENGTH Of NO-PRACTICE INTERVAL (MONTHS) 

t 

2 

3 

4 

5 

6 

1 

• TEST 

• WARMUP 

• TEST 

• TEST 

• WARMUP 

• TEST 

• TEST 

• WARMUP 

• TEST 




2 


. ^ 

• TEST 

• WARMUP 

• TEST 





3 



• TEST 

• WARMUP 

• TEST 





4 




• TEST 

• WARMUP 

• TEST 



5 







• TEST 

• WARMUP 

• TEST 

6R 



• REHEARSAL 

• TEST 

• WAHMUP 

•test _ 1 




7R 

REHEARSAL 

REHEARSAL 

• REHEARSAL 

• TEST 

• WARMUP 

• TEST 




8R 






• HI he ARSA l 

• TEST 

• WARMUP 

• TEST 

9R 

REHEARSAL 

[ REHEARSAL 



REHEARSAL 

REHEARSAL 

— — 

REHEARSAL 

• RE HE AREA! 

• TEST 

• WARMUP 

• TEST 


The first five groups received no relevant practice during the retention 
interval. One of the five groups was tested one month after the com- 
pletion of training, another group two months after training, another 
after three months, another after four months, and the last after six 
months, additional experimental data were obtained from the one - 
month group by retesting at the end of the second and third months. The 
first and second month retention tests thereby served as dynamic warm- 
up practice sessions for assessing the effects of monthly (distributed) 
dynamic warmup practice on skill retention over i months. 


The remaining four groups were used to measure the effects of static 
rehearsal practice after time lapses of 5 and 6 months. Two of these 
groups received rehearsal practice after the 3 or fc month retention 
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Interval, followed immediately by retention testing. 1 ht* other two 
groups received rehears.il practice every month during the retention 
interval and then once again at the end of the interval immediately 
prior to testing. 

Each static rehearsal refresher training session was identical for all 
subjects in the rehearsal practice groups. The frequency of, and time 
at which this rehearsal training occurred, is depicted in Table 7. The 
rehearsal training consisted of: (a) a review of the flight training 

manual used during origin. ‘.1 training, (b) a series of fourteen 8 x 10 
photographs of the cockpit environment, and (c) a written rehearsal 
test (Appendix). After the subjects arrived for their rehearsal brief- 
ing, they were read a standard introduction which reiterated the pur- 
pose of the study and what was expected of them. They were then pro- 
vided a flight control manual for self review and the copies of the photo- 
graphs of the displays. These photographs were black and v/hite, 8 x 
10 glossy prints sequentially depicting the continuous control task dis- 
play panel as it appeared at each of the 13, 2U-sec checkpoints and at 
orbit insertion as specified on the guidance reference card (Appendix, 
Figure A-3). 

Upon completion of the flight manual review, the subject was instructed 
to review the photographs , paying particular attention to the coordina- 
tion of the instrument readings at each checkpoint, in addition, the 
subject was instructed to try to anticipate the future flight progress as 
a function of the depicted instrument information. The next photograph 
in sequence provided the subject with feedback on the correctness of 
his predictions. After reviewing the flight control and procedure task 
briefing materials, the subjects were given a seli'-test in narrative 
form. These tests were designed to provide further reinforcement of 
key flight control and procedural operations and to assist the subjects 
in correcting misinterpretations of the tasks. Hie self-tests were 
jointly reviewed by the subject and the experimenter lor correction 
and clarification. 
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immediate U)n.uuif: Warmup practice was provided to til subjects in 
.11 groups i-' .« function oi retention testing. I he first task pe rtormance 
during the retention test, used to measure the effects of time and re - 
fresher training technique, w .s also used ns the first of <i series of 
tddition .1 continuous control flights and procedure sequences. I'he 
performance dnt t t ken after completion or this series of task ope ra- 
tion*- was a measure ot tire effectiveness o 1 immediate dynamic warmup 
practice on skill retention. 

Pr r for man c e d et ention T est ing 

Pretest calibration checks of the simulator operation and flight dynam- 
ics were made prior to skill retention testing for each subject. Because 
the training and testing schedules overlapped, the simulator was vir- 
tually in continuous operation from the start of training to the end of 
testing, and routine recalibration checks showed no significant fluc- 
tuations in the simulator. As an additional measure, however, a series 
of real time and 10 times real time automatic flights were flown prior 
to the testing on each subject. Performance measures of these flights 
were compared with performance me » sure s of lutomatii runs taken 
during that subject's training to ensure that the simulator was function- 
ing the same for each subject. In addition, experimenter test pilots 
flew several flights prior to the subject's arrival in the simulator area 
to assess handling qualities and simulator characteristics. No signif- 
icant changes in simulator operation were observed. 

After the prescribed retention interval, each subject returned to the 
simulator area for skill retention testing. The subjects were told that 
their flight control and procedure task skill retention was going to be 
measured during the test session. If a subject was assigned to one of 
the static rehearsal refresher training groups, he received a complete 
rehearsal briefing prior to flight testing. The subject was then seated 
in the test chamber, the door was closed, and the intercommunications 
links between the subject and the expe rimenter were checked. The 
flight control guidance reference card, mounted on the instrument panel, 
served as a checklist for the tlight control task, and the procedure 
t sk logic flow diagram w ts provided as a checklist for the procedure 
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task. I he flow diagram was held in t lidded * .mriiiiun \ * • !tp t<> 1 1 >« 

test chamber bulkhead. 1 h* subject was instnul' d nut ! > r< • v th« 

procedure t.ihk checklist until alt« r tie countdown w * completed .out 
♦ he mission started. A special electrical circuit was mat died on t»< 
bulkhead mounted clip to d< t «• ct it the checklist v < ■« mm r<; ;>riur to 
the start of the flight. This system prov« d to be uwipu i* -u 11 
subjects followed the instructions 

During the retention »* si session each oibiett Me.v tin initial i- t. 
test flight followed by lour more lli^iit procedure <qu- me* \ppr >v; 
mately one minute was requited between r rl> flight m the >.> • ir* ot 
five to readout the pcrlormunct data arid re • et tie ami t u At the 

end of five flights, the -subject wa pi rmit|« d to t m > mu. d< br« . 

at which time he could t;et out d tin trM ihambcr and . t *- * tit in- > .,* 
After the rest period, the .-ubject re-« ntered the ch-mt* t and con* 
tinued to fly another i iseri« s of five flight- and protcunre sequence 
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3. RESULTS 

ii< !udy data were analyzed as two separate evaluations for each of 
the two task types. 1‘he first, evaluated the effects of the duration of 
ti e no-practice r» tent ion intervals and the effects of dynamic warmup 
pr. ctu* on skill retention. Data for this evaluation were obtained 
from the firs* ^-subject groups. The second, evaluated the effects of 
static rehearsal practice and dynamic warmup practice on skill reten- 
tion .a 1 1 if; 3- and 6-month retention intervals. The last four subject 
groups (till, 7 R, HR and 9R) provided the rehearsal effects data, and 
t!u‘ 3 and 6 months groups from the first evaluation provided the warm- 
up effects data. 

Continuous Control Task 

F ? jj; t:t ^ of No -I'r.utuc Interval and Dynamic Warmup Practice 

The effects ol duration of the no-practice retention interval and the 
effects of dynamic warmup practice are depicted in Figures H, 9, 10 
aid 11 for tin flight control performance measures of altitude error, 
integrated altitude error, altitude rate error and integrated pitch 
error, respectively . The data plotted are the difference between the 
retention test and the qualification performance for each retention 
interval group. The qualification performance baseline was the per- 
form. mcr achieved by each group at the end of training. The no-prac- 
tiv» retention L si data was obtained from the first flight at the end of 
the retention interval. The retention test with the benefit oi one 
»l \ n.iinii warmup practice was obtained from the second flight at the 
end i >t th retention interval, and the retention test with five warmup 
pi . >i tu es w.ih obtained from the sixth tliglit at the end of the retention 
ml «■ r v.i l . 

1 lu d«ta were analyzed using a two factor, analysis of variance tie - 
iga, with repeated measures (subjects nested within groups). 1- igure 
!. in puts the analysis plan and ANOVA summary for the effects of 
no practice and dynamii warmup practice on skili r »• ntiun. I he 
results <>t these four ANOVA'# and Duncan's Multiple Range tests arc 


40 


ALTITUDE ERROR DIFFERENCE i FT) 
(RETENTION TEST MINUS QUALIFICATION TEST) 


D1 80- 1 S08 1 - 1 



Altitude Lrror at Orbit Insertion — Ef feet of Retention 
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Figure 8: 




INTEGRATED ALTITUDE ERROR DIFFERENCE (KFT-SEC) 
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RETENTION INTERVAL (MONTHS) 


Figure 10: Altitude Rate Error at Orbit Insertion — Effect of Retention 

Interval and Practice on Performance 
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INTEGRATED PITCH ERROR DIFFERENCE ,'DEG-SEC) 
(RETENTION TEST MINUS QUALIFICATION TEST) 



Figure 11: Integrated PJtch Frror-~Ef f ect of Retention Interval 

and Practice on Performance 
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ANOVA SUMMARY 


SOURCE dt 


8ETWEEN SUBJECTS 24 

MONTHS (Ml 4 

Ss WITH IN GPS 20 

WITHIN SUBJECTS 75 

TESTS IT) 3 

TM 12 

T * Ss WITHIN GPS 60 

TOTAL "'gg 


Figure 12: Experimental Design for Effects of No Practice Retention Interval 

and Dynamic Warmup Practice on Skill Retention 


depicted in Table 8. The general indications from the results of the 
analyses and plots of the data are that performance on all measures 
degraded with time with a general trend toward greater skill degra- 
dation after 3 to 4 months without practice. Dynamic warmup prac- 
tice was generally effective in maintaining performance at the train- 
ing qualification levels. 

Altitude Error . The data obtained using altitude error at orbit 
insertion as a measure of performance showed a significant degrada- 
tion occurring between the training qualification test and the retention 
test at the end of the no-practice interval. The duration of the reten- 
tion interval was not significantly related to the amount of degradation 
ob' erved. However, it can be seen in Figure 8 that the degradation 
was relatively minor at the shorter intervals and reached an apparent 
asymptote after intervals of 3 months and longer. 

The magnitude of the degradation was well within the range of prac- 
tical importance, reaching an average of 2700 ft of altitude error after 
no practice for the 3 month group. When compared to the 868 ft of 
average error at the end of training (qualification baseline for the 3- 
month group), error after the retention interval was increased by a 
factor of 3. 1 or 1,832 ft. For the 4- and 6-month groups, error was 
increased by factors of 2. 3 and 2. 5, respectively. 
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Table 8: Summary of Analysis of Variance and Duncan's Tests for Effects 


of No Practice Retention Interval and Dynamic Warmup Practice 
on Flight Control Skill Retention 


VARIABLE 

PERFORMANCE TESTS 
ANOVA DUNCAN'S (< .05) 

MONTHS 

ANOVA DUNCAN'S (< .051 

ALTITUDE ERROR 

< .05 W Pi QW 1 NP 

NS 

ALTITUDE RATE ERROR 

<.05 W 5 QW ] NP 

NS 

INTEGRATED ALTITUDE 
ERROR 

<05 W 5 QW 1 NP 

NS 

INTEGRATED PITCH 
ERROR 

<■05 W & QW j NP 

— 

< .05 31246 


LEGEND: 

Q = QUALIFICATION 
NP - NO PRACTICE 
W 1 = 1 WARMUP PRACTICE 
W b - 5 WARMUP PRACTICES 


ANY TREATMENTS UNDERSCORED BY SAME 
LINE ARE NOT SIGNIFICANTLY DIFFERENT 


After one warmup practice performance improved at the longer reten- 
tion intervals. With five warmup trials performance was without 
degradation at any retention interval. While the plots of the data 
showed some differences between qualification performance and per- 
formance at the two levels of warmup practice, the Duncan's Test 
failed to distinguish any significant differences. 

Integrated Altitude Error and Altitude Rate Error . Significant 
degradation was found at the end of the no-practice interval tor per- 
formance measured by integrated altitude error (Figure 9) and altitude 
rate error at orbit insertion (Figure 10). The Duncan's test detected 
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no significant differences between the qualification performance and 
performance at the two levels of dynamic warmup piactice. Further, 
the Duncan's lest failed to distinguish any differences between the 
retention test with no practice and the retention test with one warmup 
practice. While not statistically significant, plots of the data showed 
apparent differences in no-practice skill retention as a function of 
duration of the retention interval. For the measure of altitude rate 
error, the greatest degradation occurred at the 3 to 4 month intervals 
and with integrated altitude error the greatest degradation occurred at 
the 3 month interval. With an average baseline qualification perfor- 
mance error of 29 ft-sec, error for altiiude rate was increased by a 
factor of 2. 5 without practice. Integrated altitude error was increased 
by a factor of 2. 1 at the 3 month interval, from an average qualification 
baseline; of 307 ft-sec to 653 ft-sec after no practice. 

Opposite to what would be expected, the b month interval performance 
not only failed to show a large performance decrement but it failed to 
show any degradation whatsoever for the two performance measures. 

A thorough review of simulation profile stability records, test days 
and test log failed to uncover any unusual procedural or hardware 
differences which would account for the obviously unusual retention 
performance of the 6 month retention interval group. An explanation 
can be postulated, however, which involves the task orientation of the 
subjects in this group. There was anecdotal evidence that, after a 
half year, the subjects in this retention interveil group had essentially 
forgotten how to integrate the task elements. Because the overall 
task load was so great, the subject locked in on following the com- 
manded attitude and altitude rate profiles, both oi which had received 
considerable emphasis during training. In attempting to do so during 
the first retention interval flight, the subjects flew a profile which 
had an acceptable altitude rate error and integrated altitude error. 

This approach, however, is one that neglects other elements of the 
total task and which normally resulted in high integrated pitch error 
and altitude error at orbit insertion. lAiring the first test flight, the 
requirement to use all oi the displays to control the vehicle adequately 


37 


D180- 1 5081 - 1 


and consistently became reinforced and was put to use during the 
second flight. This one warmup practice and the concurrent awareness 
of the total task resulted in improved altitude error and integrated 
pitch error at the expense of altitude rate error on the second flight. 
After 5 dynamic warmups, the practice with flight control based upon 
all displayed information had reinstated performance on the totally 
integrated task. 


The results of the Duncan tests detected no significant differences 
between performance at the two levels of warmup practice and at the 
end of training. The one apparent aberrant failure of dvnamic prac- 
tice with five warmups, depicted by the mean performance of the 2 
month group as measured by integrated altitude error (Figure 9), was 
due to an unusually high error for one subject. His error on this test 
was three times greater than his no-practice performance and ex- 
ceeded by a factor of 2. 8, the average error of the other 2 month 
group subjects. 

Integrated Pitch Error . The results for performance as measured 
by integrated pitch error were straightforward as can be seen in 
Figure 11. Performance was significantly degraded without practice 
at the longer retention intervals and the effect of warmup practice 
was to reduce the magnitude of the degradation. Ihe Duncan's test 
failed to find any difference between qualification performance and the 
two levels of warmup performance. Unlike the other measures of con- 
tinuous control performance, integrated pitch error showed signifi- 
cant differences between retention interval durations. Degradation 
occurred after 3 months reaching an apparent asymptotic maximum 
at four months, exceeding average qualification performance error 
by a factor of 1.7. 

Effects of Static Rehearsal Practice at 3 and 6 Month Intervals 

The effectiveness of static rehearsal practice methods for countering 
skill degradation at 3 and 6 month no-practice intervals is depicted 
in Figures 13, 14, 15 and 16 for the performance measures of alti- 
tude error, integrated altitude error, altitude rate error and integrated 
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altitude error, altitude rate error and integrated pitch error, respec- 
tively. The data plotted is absolute error measured from the desired 
flight profile. Two of the rehears.il groups provided the data for im- 
mediate rehearsal and distributed rehearsal at the 3 month interval 
and the two remaining subject groups provided the plots for distributed 
and immediate rehearsal practice at the o month interval. Included 
in the figures are data from the 3 and o month groups from the first 
evaluation, which provide a comparison to the error levels for no 
practice and five warmup practice trials. The plotted qualification 
performance levels are the mean of the three groups at the 3 month 
interval and the three groups at the 0 month interval. 

The data were analyzed using a three factor analysis of variance de- 
sign with repeated measures on one factor. Figure 17 depicts the 
analysis plan, an ANOVA summary for the between-group effects of 
months and practice methods, and the within-g roups effects of per- 
formance tests (addition of dynamic warmup practice) on skill reten 
tion. 


PERFORMANCE TESTS 


O* 
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ANOVA SUMMARY 


SOURCE 


BETWEEN SUBJECTS 

MONTHS (Ml 1 

METHODS (PI ? 

MP 2 

S» WITHIN OPS >4 

WITHIN SUBJECTS 00 

TESTS (T| 3 

MT 

PT 6 

MPT 6 

r . Si within ops n 

TOTAL 1 10 


Firure 17: Experimental Design for Effect of Practice Methods on Skill 

Retention After Three and Six Months 
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I j i general, the results depicted in th< figures indicate th.it static 
• c lira rsul techniques reduced tin- magnitude of the skill degradation, 
with distributed rehearsal more effective than immediate rehearsal, 
fhe pertormame measures responded somewhat diitcrentl\ to the 
pplu ,tn>n ot the retention methods winch tended to indicate that tin* 
four performance v nablcs were measuring different elements of the 
task. 

Ha beneficial i fleets ol dynamic v >rmup practice and static rehear- 
sal practice appeared to form i continuum in terms ol practice method 
complexity. The data for altitude error showed an almost classic pro- 
e re ;• si or. in reduction of degradation as .» function ot method. Lxccpt 
tor the previously discussed deviant no-practice data lor the b month 
group, data 1 or integrated altitude i rror and altitude rate error gen- 
erally followed the same pattern. However, the data for integrated 
pitch error showed practically no difference between the static rehear- 
sal methods md dynamic warmup. While not plotted on the figures, 
the addition of warmup practice to the static rehearsal practice meth- 
ods (iiml or nth retention t «* ?. t ) did not reduet skill degradation beyond 
th . i >t dynamic warmup practice alone tor any group. 

Altitude i rror. fhe data obtained using altitude error at orbit 
i - 1 • r 1 1 o ■ as a measure of performance showed no significant retention 
differences as a function of months. The data, depicted in Figure 13, 

■ bowed a strong trend (p . . 10) towards differences between practice 
methods. Statu rehea r. sal immediately preceding retention testing 
n duced the extent ol degradation over that found for no practice. 
Distributed rehearsal practice further reduced the magnitude of skill 
dew radation to the point that, it the 3 month interval, performance 
equalled that at the end of training. However, dynamic warmup prac- 
ne was the only method which reinstated performance to training 
qualification levels at the 6 month interval. 

I ntegrated Altitude Error . The effects of practice methods on 
l • i performance as measured by integrated altitude error were sig- 
; i f i c at (p • . 05). There was no difference in skill retention as a 
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function <»f months. Distributed static rehears. ti practice was ton- 
morr efficient th.»n immediate static rehearsal practice in 
reducing null degradation. An . an be s» en in Figure H, immediate 
rehears 1 failed to reinstate pr’dor u.mce to qualification levels, 
while t!i> l ributed rehearsal and dynamic warmup practice wero sul - 
tic lent to prevent shill dee,: adat ton. live Oir.ian'# tent showed to ,r 
the distributed rehearsal practice was si..: ticantly difte r • • nt (p 

from tin no-practice performance levels, while immediate t el ears l 
was not. Distributee ohcarsal plus warmup practice tail* d to mow 
. ny improvement over 5 dynamic warmup practices ilorve, t.o^fvc', 
distributed rehearsal plus warmup w.; » . ; ; 'iiia .m; imp. .ement over 

immediate rehearsal with warmup. 

1 hr interaction between the no-pr.«etic« performance ud t < .-<si 

ate rehearsal performance is . tunciion “f the umu.a it •> .u ti group 
no -practice data as previously discussed >nd mo; h.. .«* •* »• * 

the absence oi any statistical improve m**rt in performance >! immedi- 
ate rehearsal over no-practicc. live .ipp rent dmcrepat.. s wen n 
performance wit!, no-practice ad pc r torm.-mce with i> « i •* t \ p« •. .t 
rehearsal practice w.-.s probably a function of the subject u>d< . 
standing of the task at the end of the retention inter -. vl. 1 1 » a.ti 

no-practice group, focussed on only some of t r > « t.rsi <• ic .• ... at*. .md 
as such, first retention test performance on integr.ted dutmlt e r i »r 
was unusually good. On the other hand, the subject* t a reter. ed 
rehearsal practice had an understanding and appreciation of ti.« t it 1 
task requirements reinforced during the rehe.irs.il, md Theretor*- 
attempted to perform well on ill elements or the Jhgnt . .mtroi t • • > . 

It must be assumed that if the subjects in the o inontl no-prat in - 
group had attempted to attend to all task elements, the no- pi t ie« 
data would have shown average error t Ia.it was etpi il to oi gre iti-r 
than that experienced by the i month group. 

Altitude Rate Error . No statistically significant practice nethod 
differences were detected as a function of the performance measur e of 
altitude rate error at orbit insertion. This failure to find statistic . t 
significance was probably due to the unusually low error performance 



D180-15081-1 


» c ! le d with no practice by the 6 month group. There was a trend 
tow rtls difference between performance at the two retention in- 
tervals (p • . 10). It car. oc seen from Figure 15 that the static re - 
he. r>.<l methods contributed greatly to this trend. Both immediate 
> t - 1 and distributed rehearsal showed little degradation at the 

month retention interval; however, at the o month interval both 
hawed i greater increase in degradation. Only distributed rehearsal 
■,h rlornwnce remained relatively close to qualification performance 
levels. As with integrated altitude error, the previously discussed 
aberrant data for the 6 month no-practice group made clear compari- 
sons between practice methods difficult for the altitude rate error 
measure. I his difficulty is relieved by the assumption that perfor- 
..raa after 6 months would have been severely degraded had the sub- 
m 1 . 1 ttended to the total task. As it is difficult to assume that prac- 
lm .>1 «ny type is worse than no practice at all, this interpretation 
ppea ri d appropriate. 

Inte grated Fitch Error . There was little practical and no statis- 
tic 1 difference between the practice methods and qualification perfor- 
ii .i:n is measured by integrated pitch error. Figure 16 shows how 
. lonely tl»e data for the practice methods was grouped and the signifi- 
i 'lit dill« rence (Duncan’s, p <.05) between the practice methods and 
: o pi ictiie. Both immediate and distributed rehearsal clearly mair.- 
t . in ed acceptable performance. Warmup alone did not, and while not 
.'significantly different from the qualification performance levels, the 
magnitude of degradation could have practical importance. The corn- 
bin. it. on of warmup and distributed rehearsal, while not plotted, re- 
sulted in the best test performance. 

I'here was a significant interaction (p < . 01) between methods and per- 
formance tests. The data showed relatively small differences across 
performance tests for the static rehearsal method groups, and for the 
dynamic warmup group when warmup practice was used (2nd and 6th 
retention test, Figure 17). Therefore, it was the large increase in 
degradation with no practice at the end of the 6 month retention inter- 
val which caused the significant methods by tests interaction. 
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There was a significant difference between performance at the 3 and 
6 month intervals (p < . 01). It can be seen in Figure 16 that each 
measure consistently showed greater integrated pitch error at the 6 
month interval. However, from the analysis of the training data it 
was further noted that the baseline qualification performance of two 
6 month groups was also greater. While the differences between per- 
formance measures were relatively greater at the 6 month interval, 
they were small. These minor increases and the absence of a sig- 
nificant methods by months interaction suggested that there was no 
practical difference between months for the practice methods. 

Procedure Task 

Effects of No Practice Interval and Dynamic Warmup Practic e 

Five procedure task operations were completed in a specified sequence 
during each flight with the order of the sequences reversed from flight 
to flight. Table 5 depicts the five procedure task sequences in the 
order they were completed during each flight. At the end of training, 
the last procedure task sequence in order (Sequence No. 4) was the 
most complex in terms of difficulty and number of decisions. This 
same procedure sequence was the first tested at the end of the reten- 
tion interval. Thus the qualification performance baseline was the 
average performance achieved by each group at the end of training on 
Procedure Sequence 4. The no practice retention test, data was obtain- 
ed during the first flight at the end of the interval on Procedure Se- 
quence 4, 

Due to the very small amount of warmup practice afforded by one pro - 
cedure task trial, ten warmup practice trials were used as the minimum 
amount of practice. The first procedure sequence of the third flight 
at the end of retention interval provided a measure of dynamic prac- 
tice with ten warmups. The retention data with <20 warmup practices 
was obtained from the first procedure operation (Sequence 4) of the 
fifth retention test flight. 

The effects of the no practice interval and the effects of dynamic 
warmup practice were evaluated using both the time and error measures 
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of procedure task performance. The data were analyzed with the 
same two factor analysis of variance design used for the continuous 
task (Figure 12). The results of these four ANOVA's and the Duncan’s 
Multiple Range Test are depicted in Table 9. 


Table 9: Sumnary of Analysis of Variance and Duncan's Tests for 

Effects of Mo Practice Retention Interval and Dynamic Warmup 
Practice on Procedure Skill Retention 



VARIABLE 

PERFORMANCE TEST 
ANOVA DUNCAN'S K.05) 

ANOVA 

MONTHS 

DUNCAN'S (< 05) 

i 



INITIAL RESPONSE TIME 

<.01 

QW 20 W 10 

NP 

NS 


•* 

l - 

DECISION TIME 

<.01 

QWjo vV io 

NP 

NS 


> 

it. 

SEQUENCE TIME 

<.01 

Q W 2 0^10 

NP 

NS 


'/■ 

TOTAL TIME 

<01 

QW 20 W 10 

NP 

NS 

1 2 3 4 6 









L’ >JD: 

Q -- QUALIFICATION 

NP = * 3 PRACTICE 

W 1Q 10 WARMUP PRACTICE 

W 2Q - 20 WARMUP PRACTICES 


ANY TREATMENTS UNDERSCORED BY SAME 
LINE ARE NOT SIGNIFICANTLY DIFFERENT 


In general, performance degraded significantly at the end of retention 
interval for all time measures of performance. Figures 18, 19, 20 
and 21 depict the effects of retention interval duration and dynamic 
warmup practice on procedure task performance as measured by 
initial response time, average decision time, average sequence time 
and total procedure time, respectively. There was an apparent trend 
towards greater skill degradation with longer no practice intervals. 

The absence of any differences between qualification and the retention 
tests with warmup prevented statistical detection of months effects 
for the no-practice data. However, as can be seen from plots of the 
data, retention performance on all measures showed a sharp increase 
in degradation after 4 months without practice. 

\ 

Total Procedure Time . As an overall measure of procedure task 
performance, the total time required to perform the most complex 

*• 

procedure sequence provided a dramatic demonstration of performance 
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RETENTION INTERVAL (MONTHS) 


Figure 18: Initial Response Time — Effect of Retention Interval and 

Practice on Performance 
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degradation and warmup recovery (Figure 21). At the shortest reten- 
tion interval without practice (1 month), the average total time to com- 
plete the procedure sequence was approximately live tunes greatei 
than that required at the end of training. This magnitude of degrada- 
tion continued through the 2 and 3 month, no-pructice retention mter- 
v Is. A dramatic increase in degradation was seen alter -i months 
without practice , whe re the total time required to complete the proce- 
dure was 17 times greater than that the end of training. When ten or 
more dynamic warrnup procedure task trials preceded the retention 
test, no appreciable degradation in performance w..s found it any rt - 
tint ion interval. 

There was a significant performance tests by months interaction (p .. 
.03). From the plot of the tot .1 time data in Figure 21, it can be seen 
that there was essentially no difference between qualification and warm- 
up performance, and that performance was constant across retention 
intervals. The no practice performance was degraded, and this cleg- 
radation increased with the longer retention intervals. The signifi- 
cant tests by months interaction detected these differences and indi- 
cated that no practice performance degradation increased as .1 function 
of the retention interval duration. 

Initial, Decision, and Sequence Time . The same general effects 
of the practice methods and retention intervals were seen for the dis- 
crete elements of procedure task performance: initial reaction time, 
decision time and sequence time. Initial response time was a very 
basic measure of psychomotor performance which required a minimum 
of task understanding or decision making. The pilot only had to re- 
member, and then make, one response to the flashing warning light. 

With such a basic measure of psychomotor performance, the magnitude 
of skill degradation was not expected to be very large even over the 
longest retention intervals. The results depicted in Figure 1H showed 
that this was, in fact, the case, with response time increasing from 
about 1 second to 1.8 seconds at the 3 month interval. However, even 
with this basic measure, performance degradation increased sharply 
at intervals of -4 months and longer without practice. 

53 



- ■w H r«5*r t-‘ a -vs *• y- * • - . ■ 


1)1 HO - 1 5081 - 1 


iv- *r .>M nun- performance a:. depicted in Figure 19 showed a greats. 

oi degradation without practice thar. did initial response 
K a Thi* was as expected, because as a performance measure, 
iicuMo:, tin.*- required greater cognitive involvement, memory oi tnul- 
i|.li decision choices and responses wliich were mort susceptible 
Ju tin- degrading iulluences oi lime. Lip to intervals oi i months, 
decisions required Irom four to seven times longer than that at the 
i nd ot training. Similar to the measures of total and initial response 
time iivi rage decision time showed a large increase in degradation 
after lour or mort months without practice. fhis degradation amounted 
to an increase in average decision tune of from 0. 8 seconds at quali- 
fication to 11.7 seconds alter -4 months without practice. Considering 
that each procedure required four separate decisions, degradation ot 
this magnitude was of considerable practical importance. 

Sequence time which required remembering a set order oi sequential 
responses showed a level of degradation that w .s intermedi te between 
initial and decision times for the lirst i months without pr dice. Af- 
ter -1 months, the ability to remember the order of responses degraded 
rapidly as can be seen by the sharp increase in average sequence 
time depicted in Figure 20. 

Dynamic warmup practice resulted in reinstating performance lo the 
levels achieved at the end ol training lor each ol the discrete elements 
ol procedure task performance. Hu- Duncan's test showed no signifi- 
cant difference between qualification levels ol performance and pe r - 
formance at the 2 levels of warmup practice. Significant dillcienees 
were found (Duncan's: p < . 05) between these three performance tents 
and the no-practice performance test. 

Error Performance. Procedure task performance as measured 
by procedural errors likewise showed degradation after intervals ol 
time without practice. Both sequence and decision e. rors were iound 
to occur with no-practice retention intervals of 2 months or longer. 

Hu- average number of sequence and decision errors are depicted in 
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Figure ZZ with the combination of both showing the total number of 
errors committed at each retention interval. No errors occurred for 
the shortest (1 month) no practice interval, and with intervals of Z 
months or longer the number of errors remained relatively constant. 
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Rigare ZZ: Average Number of Procedural Errors on First Trial 

After Retention Interval Without Practice and With 
Rehearsal Practice at 3 and b Month Intervals 


Included m Figure ZZ are the average number of errors committed by 
the immediate and distributed rehearsal groups at the 3 and 6 month 
retention intervals, it can be seen that decision errors accounted for 
more than half of the total error occurrences under the no practice 
conditions. At the 3 month retention interval, the static rehearsal 
practice methods eliminated all sequence and virtually all decision 
error occurrences. At the 6 month interval, distributed rehearsal 
pr c t i c « • eliminated sequence errors and virtually all decision errors. 


- lie not plotted, dynamic warmup practice eliminated the occurrence 
oi .til errors except at the 6 month interval, where an average of 0.4 
er:ors w« re conrm.ted per procedure trial, equally divided between 
•cq .cnee md decision errors. No errors occurred for any combination 
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As with the continuous i unit ill tank r . I . Iltu- Itir data lit (foe r alu- 
•ttion were obtained (rum the immedid* «c.e i = t ...j do»t<i »u a re- 
hearsal groups »t the i month mtr r u • t • to , t ui >i< r*.,i |>ruup: 
at the *> month interval, L.tluijr li »i. th* rv ft ittiiii we t r ( lit r 

month warmup group data ia pruvnk »o-pi 4 u> < and* n . ,p p t 
error level comparison* All qaaluu iim ifun d: pi nu »> 

lit tlie figures Were the mean u! tl « 11 . r* « I at tl » atouU. l ift i* 

v i « 1 , and the 3 groups a the '■ moult. inter v a 

liUtlil ltesponse lime liot. il response Iim. ft. ,t( ol 

pr • cticc methods i& depleted m 1 igur« J tor U « out < m.a. r« '« 
t ion intervals. I he data ii.u* m, pr .cti. >1 .»i sigmtiiaHl •oiu-r- ices 

h* tWt'tll pl .li till mi II: 00 l 1 it la l].« 1 r : . • *1 I fir .1 .. . i . : ft 4 

1 he main effect ot performance rests inrii a» a. si k » a it ott ip -o-i) 
degradation ot performance on the first p* • t . , t.-et at «- t ad 

ot tin* retention interval. 1 lie significant (leg! tlx lion w a . turiittafl 
ol t he no - practice da t-* laf llit w » s - oup t r 1 *u p 1 a a 1 . i« f . tic • igi 11 1 1» 
tt* sis -by -method* interaction Ip US) a ig oil* a > o p ■* l 

ditte rrn<Ck wert found belwr* 1 warmup .nd th« « OO itimal 1 ot f o t static 
rehearsal methods With Warmup As w oid tt lie r p« cleat Will a. oh 
a simple measure Ol periormam.* as initial rcspui.se lime, ail tc • h * 
niques reinforced the relationship between t < *tio. a .* imi ippro- 
p r n> t e res pun se , essentially reinstating pc riort.a . cc to , o . 1 ill c >tiu|i 
ll-els While !iOt SlgnUlCaid, addlUOfial Warn, p pr .ctl. c tia.la lu fe- 
ll i r reduced itiici.il response ti ne atet tti* o ki.im mu ival. .mt 
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the combination of warmup and either method of static rehearsal 
totally eliminated degradation. 
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RETENTION INTERVAL (MONTHS) 


Figure 23: Initial Response Time Effect of Static 

Rehearsal Practice on Performance 

Decision Time - The average time required to make each of the 
four decisions in the procedure task sequence is plotted as a function 
of retention method and interval in Figure 24. The main effects of 
retention methods and performance tests were significant (p .005). 
Similarly, the months by performance tests, retention methods b> 
performance tests and the months by methods by tests interactions 
were .ill significant (p <. 005). 


57 




D1 80- 1 5081 - 1 


The impact of all of these effects are revealed by Figure 24. The 
methods effect showed that immediate rehearsal and distributed re- 
hearsal groups had less degradation than the warmup group (Duncan's 
p . 05). The test effect, which indicated significant degradation on 
tin first retention flight, coupled with a significant methods by tests 
interaction indicated that it was the no-practice data for the warmup 
s roup that caused the significant degradation differences. Both the 
months by tests and months by tests by methods interactions indicated 
t he greatest degradation was on the first performance test for the 6 
month no-practice data. While not significant, degradation was not 
totally eliminated until the combination of both warmup and rehearsal 
was used. 
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Sequence Time . I he d ta tor overage sequence time \v.is strik- 
ingly similar to th.it found .or initial response tinn wit!, one notable 
exception, the relative degradation at the t* month interv 1 wit! out 
practice was dramatically greater (Figure h). 1 hr significant ui.nu 

effect of tests (p v . 025 ) indicated severe degradation on the ttr a t « 
tention test with an improvement in performance with iddilion ot warm- 
up practice. A strong trend towards a significant method-. by tcit* 
interaction (p< .10) indicated that the test c fleet w.i.^ dm to tin- no- 
practice data for the warmup group. fhe malvsi^ found no .nil 

differences across methods; however, it w.is notedth.it eitir. « tnti'iuu-il 
amounts of warmup practice or the addition ot warmup pr.<«.iu< to 
either static rehearsal method reinstated performance to t:« < ^ . t • 1 1 ; « 
cation levels (Duncan's, p < .05) 

Total Procedure Tune . The effects of rehe in<-M u«! on the 

total time required to complete the proctd..re task n d« pitted m ! l( _. - 
ure 26. The data showed that, as .» summation ol the d;si •«-*.»■ • 5 . 
ments of procedure task performance , ti« tot.1 procedure ti • »i : 
were very comparable to the results dc*< » i .u d . .ov. i • * a., 

fects of performance test* indicated that *igniJi?unt «lr _ 
occurred on the fir.->t test at the end of tin m « uim . mU (p on 

and that performance w.is reinstated by the wu fusmn o» ..ddl» *1 
warmup practice. The significant un-thoi: i Uni <>. .a 

that this degradation wa« due to the u.iMi.up gtm.p .. • d t ... 

retention performance as compared t«* tin id «- .i = .<i jiu 

As can be seen in Figure 2b mu rh* re null* .a • *• • . t i. > • >i. - . • » - 

by tc si? u.tr act ion (p • , Of.) 5 ) iu i th» r ii.du afed ti. .i •-i.it *;» . • . i . • 

was due to ihe no-practi. t data nf th« u trump g. 1>. 

tests (p ’ . 005), month* by method* fp hit, >.u t «. t m *» t> . 
action (p ,01) m<in itc- d i fi d tn< ■ . . - .mat,* . .. « - . . u t . 

dation for the w :t . i tup g roup >lt»*r >• in ...in* * ill.* u ... «» : . a « » «. 
results of the a .llyot-b .nd th< pi -ta ; t * d.»!*» i 

or pr t> c t u al dille re u « » m pe r< .■ i ..... •< i > . • . . in » a . i . : 

groups and the warmup group t »*rtf.» » n > U|>i|i:<.«iii ifiit. . . ...n 
wt r* detected between qu.lifit p i tui >«. »..«,* 

. t the end ol the retention ini* >1 v til. pi ■ i » » • t. .»< . • p* 
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RETENTION INTERVAL (MONTHS) 


Figure 26: Total Procedure Time — Effect, of Static Rehearsal Practice 

on Performance 


Although the difference between qualification performance and perfor- 
mance at the end of the retention interval with practice was not sig- 
nificant, the levels of practice depicted in figure <d6 were not comple- 
tely sufficient to reinstate performance to the qualification levels. 

G'aie rally speaking, even with the benefits of static or dynamic prac- 
tice, approximately twice the total time was required to complete the 
procedure task at the end of the retention inter vai than v/as required 
at the end of training. While not plotted, increased amounts of warm- 
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up practice or the addition of warmup to the static rehearsal practice 
methods further reduced degradation levels resulting in performance 
virtually equivalent to that obtained at the end of training. 


Distributed Warmup Practice at 3 Month Interva l 

Subject Group 1 provided data for the evaluation of no practice and 
dynamic warmup practice for the 1 month retention interval. This 
same group was retested at the end of Z and 3 months, thereby pro- 
viding dynamic warmup practice distributed over the 3 month retention 
interval. No difference in degradation was detected at the 3 month 
interval between this distributed warmup practice and the warmup 
practice provided immediately before retention testing for any measure 
of pe rfori mce. 


bZ 


D180-15081-1 


4. DISCUSSION 

The small number of subjects represented in each treatment group 
hindered a completely valid statistical representation of the results. 
Fortunately, sufficient significant differences and strong trends were 
detected to provide a reasonable representation of the results. Where 
differences of large magnitude occurred without statistical significance, 
the shape of the performance measure deg radation tunction across con- 
ditions often indicated that probable significance would have been ob- 
tained with a larger sample size. Further, in some cases, experience 
and judgement were used to determine if the differences were of any 
practical significance or importance. 

Viewed across ail performance measures, significant degradation in 
performance occurred after intervals ol no practice for both the con- 
tinuous control and procedure tusks. In general, continuous control 
performance degradation was relatively moderate until 8 months had 
elapsed without practice. At that time, degradation increased sharp- 
ly with average error 1.7 to 3. 1 times greater than at the end of train- 
ing. The duta suggested that skill degradation had reached its peak 
ut about 4 months. 

Procedure performance, on the other hand, showed strong degradation 
after only 1 month without practice. This significant level of degra- 
dation remained relatively constant through 3 months without practice. 
Similar to the continuous control task, procedure performance showed 
a sharp increase in degradation at ■? months. Further, the relative 
magnitude of procedural skill degradation was greater than that for 
tiie continual control task. As an overall measure of task performance, 
total procedure time was almost five times greater after the shortest 
retention interval than at the end of training and was 17 times greater 
after 4 months. 

The capacity of the static rehearsal and dynamic warmup practice 
methods to maintain performance was closely associated with the 
measure of task performance. For each task, dynamic warmup was 
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required to maintain skills as measured by some performance variables 
while static rehearsal was sufficient for others. In some cases, deg- 
radation was not completely eliminated until a combination oi both 
methods was used. 

For the continuous control task, distributed rehearsal prevented deg- 
radation at the 3 month interval for all measures oi performance. It 
is important to note that the rehearsal hud to be repeated at regular 
intervals during the retention period. A single immediate rehearsal 
practice at the end of the retention interval was insufficient to main- 
tain performance. After 6 months, distributed rehearsal w.i& sufficient 
to maintain performance for only two of the four measures: integrated 
altitude error and integrated pitch error. Dynamic warmup practice 
maintained acceptable performance for three of the four flight control 
measures after 6 months. While not statistically significant, and <>! 
questionnable practical importance, warmup failed to maintain per- 
formance as measured by integrated pitch error. Considering all 
measures of control task performance, the results showed that it o 
months, warmup practice or a combination of warmup and dynamic 
rehearsal practice was required to prevent the occurrence oi degra- 
dation of skills. 

Procedure task performance was effectively maintained by all prac - 
tice methods in terms of the time measures. While some differences 
between methods were observed, none were of practical importance. 
Interestingly, of the individual methods, only dynamic warmup was 
able to totally eliminate degradation; and then, only for initial response 
time at the 3 month interval. As with the continuous control task, 
the combination of warmup and rehearsal prevented degradation lor 
all measures. In terms of the error measures, both rehearsal ami 
warmup reinstated performance equally. Ihe general overall result, 
from both a statistical and practical viewpoint, was that rehearsal 
techniques effectively maintained procedural p< ri'ormance at both the 
3 and 6 month retention intervals. 
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The results reflected a fundamental difference in shill degradation 
between the procedure and continuous control tasks. While both task* 
showed a similar degradation function across retention intervals, the 
relative degradation of the procedure task was consistently greater. 

The magnitude of the degradation was clearly unacceptable at the 
shortest interval for the procedure task, and at .» level which, wa* nut 
found for the continuous control task until 3 months without practice. 

At 3 to 1 months, when both tasks showed the sharply increased loss 
in performance, flu relative degradation magnitude of the procedure 
task was five times greater than the continuous control t.«sk. Further, 
this difference between the tasks was highlighted by the finding that 
static i e hear sal methods countered degradation effectively tor the- pro- 
cedure task, while dynamic warmup practice appeared necessary lor 
retention of the continuous control task 

it was apparent that these differences between procedure and continous 
control tasks were not solely a function oi the general task type, but 
were a junction oi the type of performance that wa.* being measured. 
Within each task, the measures of skill we/e sensitive to different 
elements oi task performance, «s was shown by the different retention 
interval and retraining effects. 

I he *c task performance element* can be viewed across a continuum 
from highly cognitive information processing and decision making to 
discrete and continuous psychomotor performance. Procedural tasks 
generally involve skill* more toward the cognitive end of the spectrum 
while tlight control skills nr< more closely oriented toward the motor. 
Therefore, it can be assumedtl.it retraining methods which involve 
narrati'i-, verbal, oi pictorial task rehears *1, being essentially cog- 
nitive- m nature should be most appropriate lor procedure tasks, while 
the interactive manual control practice afforded by dynamic warmup 
should be appropriate lor continuous control tasks. 

However, skill degradation was found to vary as a function of practice 
method, differently for the performance measures of the same task. 

1 <-r example, the effects ot warmup and rehearsal termed a continuum 
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as a function of performance measure for the continuous control task. 
The data for altitude error showed an almost clasbic progression in 
the reduction of degradation as a function of method, while for inte- 
grated pitch error there was apparently little difference between the 
methods with rehearsal being adequate. Performance measured by 
altitude rate error and integrated altitude error was in the middle 
of the continuum, generally following the expected trend, but obvious- 
ly benefitted by rehearsal. Rehearsal strongly affected continuous 
control skill elements which were measured by these two variables. 
Further the benefit was most strongly observed for those subjects 
who had these skill elements repeatedly reiniorced m then memory 
during distributed rehearsal. 

Since one aspect oi the control tusk required the subject.' to maintain 
the appropriate altitudes and rates commanded on tin- proiih card, 
the card had to be regularly scanned throughout the mission. Ihe 
net result was that the task time available for the instrument mom 
toring, information integration and control response was reduced .md 
the opportunity tor error was increased i hose s-aOji cts pru.ided 
with distributed rehearsal had the altitude and altitude rate prut lies 
so well in mind that the time require u to scan uid integrate the pr >- 
file card information was minimal. 1 he net result m ti.i.-, . >-t w.-. * 
the ab ility to concentrate on monitoring the instruments and control- 
i.tg the flight with less error. 

The purpose ot this discussion and example i» to strongly point out 
that the selection of measurer of t.*sk performance is critic**! In 
this study, it can be set n that iiiore than one conclusion could ha-,- 
been readied it only' one or another of the performance measures had 
been used. Cure must ho t.»l**-n in mture studies to insure that all 
elements of task performance are adequately sampled, .»nd interpre- 
tations and conclusions arc based on not only individual measures but 
overall performance .is well. Ibis is critical not only front »ne stand- 
point of de 1 1 r mining the magnitude and r ate of ni-iil degradation, but 
equally important ior the selection or development oi the most appro- 
priate method:* or combinations of metnoda which will prevent devia- 
tion, Most certainly, much of the conflict in the literature, cone* mm*. 
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the types oi skills which degrade, when .«nd by how much, nd what 
retraining i» required, was uun*d <y tin different nn .mures oi per- 
formance used to evaluate retention of t »sl skills. 
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A I I'KN'DIX - SUIiJtCl IKAIMNC, PACKAGE 
Subnet 1 icuiunc .uid Rehear ?> ■» 1 ) ' r n 1 mg» 

Ibis, appendix contains the materials initially presentee to the test subjects 
at the beginning of their training and later used tor rehearsal briefings. 
During the pretraining orientation the material wa> presentee verbally. 
During the monthly retention interval reh< ursai briefings and prior to the 
final test, the rehearsal group subjects read tne brieting materials with 
only verbal clarification provided by the e xpe r ime ute r. lie written con- 
tinuous control and procedure task Self-tests were completed With each 
rehearsal briefing followed by experimenter correction and clarification 
comments . 


The introduction to both the. subject training and retention inter*. «1 rehearsal 
briefings were read to the subjects as tollowh 

Hoeing is under contract to the NASA Manned Spacecraft 
Center at Houston to investigate the d< gradatw ot learned 
skills. 1 he purpose ol this study eilort is to determine a 
certain learned skills degrade over time, and wn. t tech- 
niques may he applied to counteract the eltects of time-based 
skill degradation, in order to accomplish the required in- 
vestigation we (are training) (i.a\* trained) .* group ot t* »t 
subjects to perform simulated astronaut ta»**. As one of 
the test subjects, you (will burn) (learned) two tasks asso- 
ciated with operating a simulated space vehicle i . > r the *sccnt 
to orhit phase of the mission duri. c your initial training. 

Upon completion of training, <,our p« rfornwnu (will be) 

(was) test« *i for later comparison with your performance at 
the end of (l) (4) (i) (4) (6) months. 

The nrst tar.h involves manual * or.trol of a simulated a pact 
vehicle from launch to orbli insertion. It is referred to 
as the 'Continuous Control I ask in which b*»ic tligut 
Instruments are monitored and control inputs made to tl>‘' 
th* vehicle into the desired orbit. 


0180-1 SOrt! - 1 


[ hr second u?k involves a simulated failure of a primary 
fli.ht instrument and i* referred to as the "Procedure Task." 
\le ti r readings are taken and systems actuated in order to 
investigate and alleviate (u possible) the emergency situa- 
tion associated with attitude indicator failures. 


lhe following instructions were read to the rehearsal group subjects only. 

There are several groups of subjects who receive different 
types ol retention training over different lime intervals. 

Your group receive* (monthly briefings) (a pre-test briefing) 
to refresh your memory of the tasks. This package contains 
briefing materials for both the continuous control and pro- 
cedural tasks. Included With the training package are a series 
ox pf. olographs oi the flight control display panel tdKen at 
Jo second intervals during the flight, cor re sponuir.g to each 
oi the checkpoints specitied on the guidance reference card. 

Review these photographs, paying particular attention to 
the relationship between :he instrument readings. IXring 
your review, try to anticipate it. - future flight progress and 
probable instrument readings expectro t!.«- n« \t J0-second 
checkpoint. 


At the enn it each section, you arc to complete a sell' -test 
which will assist you in judging hove well you are retaining 
an unde rstanding of these task*. As a turther learning aic, 
you are to correct \our seU-test o part at your (monthly) 
skill retention U«tning. 
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Continuous Control Task 

During the performance of the Continuous Control Task, a two-st i K < 
space vehicle will be manually controlled from the ground into 
orbit at 27 3, 000 feet. 

The space vehicle weighs 3-1/2 million pounds at lift off with a total 
of 5 million pounds of thrust. The vehicle is oriented vertically on the 
launch pad (sitting on its tail) at blast-off and your primary control 
task is to manually provide the nominal rate of pitch. However, you 
are also required to minimize error deviations in the roll and saw 
attitudes, which are primarily under automatic control. 

Some of the basic vehicle attitude a. id movement definitions are ill- 
ustrated in Figure A-l. J.'he velocity vector defines the vehicle's fiight 
path at anj instant. The angle gamma is the flight path angle and is 
not displayed in the cockpit. The vehicle is illustrated in two positions 
A M , aligned on the velocity vector and "B", in a pitched up attitude. 

The angle formed by the longitudinal axis of the vehicle and the velocity 
vector is called the angle of attack ( a ). The angle of attacl is direct!', 
displayed by the cockpit instruments. The angle between the longitu- 
dinal axis of the vehicle and the local horizontal reference (horizon 
in this simulation) is the pitch angle. Pitch error, the error between 
the desired pitch angle and the actual vehicle pitch angle, is displayed 
on the Attitude Director Indicator (ADI). 

Figure A-2 shows the cockpit display arrangement. The "Guidance 
Reference Card" is placed on the upper left hand side ot the panel. 

I 'his card displays programmed altitude, vertical velocity or altitude 
rate ( 1* ), angle of attack ( » ), and velocity ( v ) and time (Figure A- 3). 
The data is displayed for each 30 seconds. The one minute data point.- 
an- underlined in red. The vehicle pitch (and roll and yaw) attitude 
must be controlled such athat the altitude and altitude rate meters read 
the values indicated on the guidance card. Immediately below the 

Gaidar a card arc located the altimeter ( h ) and the vertical veloctt 

# 

( h ) meters. 
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The "Altimeter" reads from 0 to 100,000 feet. At 100,000 feet the meter 
indicator returns to zero and the 100K light (located just to the left of 
meter) illuminates. The indicator then progresses upward, reading 
1 10, 00; 120, 000, etc. to 200, 000 feet. At 200, 000 feet the 200K light 
illuminates and the indicator needle returns to zero and star's up into 
the 200,000 foot range. Each mark on the altimeter scale is equal to 
2000 feet. 

The "Vertical Velocity" meter has a range of minus 500 feet per second 
to plus 2000 feet per second. Each increment on the vertical velocity 
scale equals 50 feet per second. This is a very important parameter. 

If the reading is off by a single increment (50 ft/ sec) at a 20 second 
check point and corrective action is not initiated, altitude at the next 
30 second check point can be off by as much as 1 r ->00 feet. 

The clock is positioned below the altimeter and vertical velocity meter. 
The button on the upper right side of the clock starts, stops and resets 
the clock with consecutive actuation of the button. There is a sweep 
second hand and a special minute hand (arrowhead shaped) that are 
used to check each of the time checkpoints dur ng the flight duration 
of 6 minutes and 44 seconds. 

The "Altitude Director Indicator" (ADI) is located in the center of the 
display panel just to the right of the vertical velocity meter. The ADI 
displays pitch error and roll attitude. When the pitch over rate is too 
slow, that is the actual pitch angle is higher than the nominal pitch 
angle, the wings on the ADI will rise above the horiz.cn bar on the 
instrument. The required corrective action is to increase forward 
pressure on the side arm controller stick to "fly" the wings back down 
onto the horizon. The wings must always be flown back to the horizon . 

If the left wing is low, the control stick is moved to the right until the 
left wing rolls to the horizon bar. 

Directly above the ADI is the "Side Slip" indicator. The range of this 
indicator reads from 15° left to 15° right in one degree increments. 

This meter reads the angle of side slip from the velocity vector. If 
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the vehicle is yawed to the right (by rotating the control stick clockwise) 
th>- side slip meter will slowly indicate the right yaw and if the control 
.•’lick is rotated counterclockwise, the meter will indicate yaw towards 
the left. 

Tne 'Compass Heading Error" indicator is located directly below the 
ADI. i his meter has a range of 10 degrees left to 10 right in one de- 
gree increments. 1 he deviation from the vehicle's programmed course 
is displayed on this indicator. Roll or yaw errors will add up to cause 
a compass heading error. In order to correct a compass heading error 
to the right, the vehicle is yawed to the left about 2 degrees for each 
degree of heading error and vice versa for compass heading errors to 
the left. 

The "Altitude Error Display" is located at the top, center of the instru- 
ment panel. This display provides real time altitude error information. 
The diagonal lines and the numerals shown on the display are not used 
in this simulation. The dot on the scope will start on the center hori- 
zontal line at the point where the left vertical line intersects the cen- 
ter horizontal line. Nominally, the dot should travel from left to 
right across the scope on the center horizontal line as the mission is 
flown. If the vehicle flight path gets below the desired altitude, the 
dot will go below the center horizontal line and vice versa if the ve- 
hicle altitude gets high. The scale on the grid on the display is 4000 
feet per horizontal line. Since there is up to 1000 feet of error inher- 
ent in the scope display, the instrument should be used as a secondary 
source of trend information and the altimeter should be used as the 
primary' source of altitude information. 

The "Angle of Attack" ( a ) meter is loca:ed directly to the right of the 
altitude director indicator (ADI). This meter has a scale that ranges 
from -+-2 5 to -25 degrees. Each increment on the scale equals one 
degree. This meter serves as a back up to the ADI and provides in- 
formation that helps the pilot mainta' n the optimum "wing" position 
on the ADI. The angle of attack meter may also be used to provide 
some attitude reference if the vehicle attitude exceeds the pitch 
limits of the ADI. 
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The "Airspeed" or velocity meter is located directly to the right oi 
the angle of attack meter. Direct control of velocity is not required 
in this simulation since thrust is automatically terminated when the 
optimum velocity is achieved. For this reason, velocity should not 
be monitored on either the profile card or the meter but instead, atten- 
tion should be devoted to the primary instruments; the ADI, the verti- 
cal velocity ( h ), and the altimeter ( h ). 

The nominal profiles for the altitude, pitch, and vertical velocity are 
plotted against time and illustrated in Figure A- 1. It can be seen that 
pitch starts at 90 degrees at time zero, then decreases smoothly to 
zero, goes slightly negative, then comes back up slightly tbove zero 
at the 6 minute, 44 second termination point. Altitude starts at zero, 
increases smoothly to a peak of 282,000 feet at 5 minutes then de- 
creases to about 271,000 feet at t> minutes, .10 seconds and finally in- 
creases to the nominal shut-off altitude oi 273,000 feet at o minutes, 

44 seconds. Vertical velocity ( h ) starts at zero, rises rapidly to a 
peak of lo50 feet per second then descends smoothly to zero at 5 
minutes and continues down to -200 feet per second at 5 minutes and 
30 seconds. Vertical velocity then starts positive, going througn zero 
at u minutes and 18 seconds, and reaching 140 feet per second at 
termination (6 minutes, 44 seconds). You are required to fly the pro- 
file as closely as possible such that you achieve the terminal altitude 
(273,000 feet) and vertical velocity (140 feet per second). Performance 
is measured on the basis of terminal altitude and vertical velocity 
error and on the total integrated pitch and altitude error. 


After you are seated and have donned the headset and throat mike, trim 
the wings to zero pitch on the ADI. The operator at the outside console 
will request this trim. After the trim has been established, the ADI 
may not be retrimmed for the remainder of the training or test session 
without upsetting the data reference. Do not retrim after the wings 
have been zeroed. After the wings have been zeroed, the standby light 
at the left of the instrument panel will blink. You will then zero the 
clock and standby for the countdown. A "three, two, one - go" countdown 
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will bt lit arc! ovt r the headset. At "gu", past t i it- Dutton that »tjru 
the clock a id proceed to fly the profile. 

in order to " t i v " tlie profile in a manner that will meet the relatively 
ittringiiit qualification crtt. rt«, it i» nefens.try that me following 
piloting technique* he applied. 

An e\r scanning technique iiiunt be developed and applied a* rapidly a 
possible, SpecUieally, all a! the primary natram-nU mint be scanned 
rapidly, and tlu secondary instruments must be used as c ro&u ... eck 
information Tht attitude director indicator (AD!) is trie instrument 
that should get about 70 perie.it ot your attention. lhi*. instrument 
should be the center ot tac eye .‘-.can pattern, th..t is, you should gia.. ri- 
al thi ADI, then at t lie vertical velocity ( l*i ), then bat*- to the ADi, 
then to the altimeter ( h >, then haek to tin ADI, then to tl « dock, tnei. 
baik to the A i Jl , etc. As soon «i a limi chc tk point passes, you at uoid 
clu ck the guidance card lor the nest check point dtiti.d* rati- t h ) .16 
altitude ( h ) values, then the a. an should return to the i!,r. » primary 
instruments, ADI, h and h. An oc <. asicu. >1 glance at U.< aititud, error 
scope (about outi or twice per 30 second*) w Ui provtd« all it . a « 1 ... cl 
information particularly it you have deviated Width (in • -s^et.- ol . 
feet) from the optimum altitude profilt Also, a* occasional glance 
«t the angle oi attack ( > ) meter (and the guidance - aid) -..11 how t : . « - 
trend that the wings will lake un the A Dl, ip or down d*p< di y. ipon 
wl.etht r « in travelling from - I io -i u , (from 30 seconds to I minute) 
or irom -S 1 ‘ to *1° (front 1 minute 30 seconds to - minutes). You 
normally will not have to glance at the saw or heading error meter- 
mure than once- each 30 seconds. 

Alter the '‘go“ signal is received, hold the wings zeroed on the horizon 
bar of the ADI. Ll this is done carefully and with very smooth, quick 
stick inputs, it is theoretically possible to fly <« perfect proliie. Nor- 
mally, an error -will occur in vertical velocity or altitude simply be- 
cause of the inertias in the lota) man-machine system. Aw noon .. w an 
error is detected In vertical velocity or altitude a correction must be 
made to the wing position on the ADI. 1- or example, if vertical velocity 
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tppf'.tni to be SC) teet pt r second low at the > .nute check point, climb 
b.i c k to the proper vertical velocity b> holding the wing* above the A ! >! 
horizon lor a Unite time period, lor example, the wings should be 
held about 1 / *4 inch above the horizon tor about IS second* to correct 
a 3t» f«-. I per second error in vertiial velocity. This is «ii <»ppro\i 
mate correction and the value* will vary with the size oj the error and 
the lime in the prolile where the error occurs. 

ii «r. error is detected in altitude the same relationship c-n the ADI 
« xints. HaUc the wings above the horizon when the altitude is law , 
a: 'i put the Wings below the horizon When the altitude gets too high. 

When correcting altitude it it* gene rail v best to identity tin altitude 
error, then select a sing position that will give the desired change in 
vertical velocity at the next check point since the altitude is determined 
by thr vertical velocity. For example, If the altitude appears to be 
.1000 ieet high at 4 minutes, the wings should he set about 1 / -l inch 
below the horizc-n bar lor about IS second* in order to .have the verti- 
cal velocit, come in SU leet per second low »t the 4 minute iO second 
>.ii> u point. The vertical velocity must then be adjusted back upward 
in order to seep from over correcting the altitude. 

Ii.t! vehicle response tirm is significant. The effects- oi holding » 
correction me, not be left a* long a* 10 seconds later. This requires 
that t tie pilot remember where he was JO seconds ago and predict 
where he will be 30 seconds in the future. The- most common mistakes 
are the following. 

1. Instrument fixation; failure to scan the instruments 
propc rly. 

Over control; using wide stick movements when only 
email displacements are required. 

i. Reference reversal on the- ADI with respect to altitude 
and vertical veloc ity. (Putting the wings above the bar 
when you are already too high. ) 

•1. Failure to conoider the blow response time inherent 
in the vehicle system. 

5. Misreading the altitude and vertical velocity mettrs. 
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Procedure Task 

A po*»ib)« tail^rr »n l ‘ attitude indicator system it* the basis for the 
procedure task. figure A-S - nows the Procedure Task cockpit dis- 
pi.r .nd control panel. While the sp.iCe vehicle is being manually con- 
trolled (Continuous Control iaok), an attitude indicator failure may be 
iodic a ten. At this time, you may reach down on the right side of the 
cockpit, release the alligator clip and ope., the procedure task logic 
iiow diagram (Figure A-b). It is cmp).a«u«d that reference to the 
diagram is left to the option of the pilot. 1/ you remember the proce- 
dure, you need not ope!, the. logic flow diagram. However, it you do 
want to Iook at the diagram, rlo not do so until you see the first Atti- 
tude Indicator Failure light. 

A- indicated on the ionic flow diagram (Figure A-e ), the first pro.edu- 
ral step after the onset ot the failure indicator light is to push the Auto 
Control' button. IhU puts the vehicle on autopilot and permits you to 
give your full attention to the emergency checkout of the attitude indi- 
cator system. 1 he next step m ti>e sequence is to push the System 
Check" button. It is important to note that the meter will only read 
while the button is held down. This action will cause the meter to in- 
dicate one of three .eadings. The meter will either Indicate low (0. 7S), 
high (1. s) or an Indeterminate , middle reading (1,0). A fourth possi- 
bility is that the meter will not read at uli (no needle movement) indi- 
cating that the meter lias failed. 

if the meter reads nigh (1. S), it indicates the system is functioning 
properly. After a high (1. S) leading tit-!: next step is to push the 
"manual 1 button and fly the vehicle manually. 

li tne meter reads low (0. 7Sj it indicates that a failure does exist in 
the system. After the low reading, the pilot pushes tae Alternate 
Attitude System" button. I his button selects an alternate system which 
will now drive the ADI instrument. In order to ensure that the alter- 
nate system is op<*r,it.ve and to ensure that the original failure is not 
common to the primary and alternate systems, you must recheck after 
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All* r .tU Alt italic System. V> he thu »* C .* . h 

button is pushed, the r* arflug will he one ot tin tkrigli mi tour poa*it*il- 

mil, U the meter real* low (t». 7 i > Alter switching to Alternate Am 

tud- Sy»tern‘ A tAll«»re e tlats in the alternate » »te n end the propel 
pr -ce iturc l* to atop tt.e v am* and - »e »• e tlik, .t i Auto Co I ml. 

Anytime the meter reads the middle react. # i*< |, a.. deter mi..u 

situation exiota end v on mu«t push tr.e System Check button «|kln. 

it tre meter re <ul» two . 01 »e . utiV' inrteterw . »tt ,eadin*a (1. >, stop 

the c he c k end continue tt.e flight m Auto Control. 

ll V > ii-ter telle to reed at all ( o needle movome t i, the S atern 
Cl e> * button aha. aid be released and pressed a • * cund time, tl two 
consecutive No Head ' indication* result, atop the check and remain 
in Auto Control. 

Anytime that a butto.. i* pushed out ol the prop^ r sequei. v«, Uie Over- 
load Reset button wtil light. Ihi* indicates that tt.e computer logU 
ox me automatic miligi t checkout system •. k been ci» rupied and the 
t allowing procedure should be lullgwcd 

l. Hush lie Overload Heaet" button. 

Z F’ush Auto Control button 

J. Rrpe.it the System Chec* procedure. 

There are lourteen dU’t* rent meter reading combinations, At the end 
oi each combination the system will U returned to manual control, 
either by pilot action or by the simulation operator. I he control status 
is indicated by the "Manual Control" or A .to Control" button indicator*. 
It is emphasized t* at whe n the "Manual Control 1 button la lighted, the 
v • hide must be controlled with manual inputs through the sidcarm 
control!*' r. 

Error and time data are taken for each test combination so you should 
strive to complete the sequential checks as quickly and accurately as 
pos sible . 
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Rclearsal Bneting SeU Tests 

L pun completion of the continuous control task section, the subject 
sc. is given the Flight Control Rehearsal lest. I his test w.*» jou.tiv 
reviewed anti corrected by the subject and experimenter prior to start- 
ing the review of t) « procedure task rehearsal material. I he Attitude 
Indisator Failure Procedure Rehearsal Test was similarly administered 
and corrected. 

FLIGHT CONTROL. REHEARSAL TEST 

e 

f IV tie u does H reach Its highest Value ? What la that Value 

J. When does H first go to O.U ft /sec. ? 

3. What is the desired L «*i min. ? At t> min. 30 sec. ? 

4. A t at is the maximum altitude attained during a normal ascent 

profile? At what time does it occur? ^ 

A hat is the altitude at ?> min. ? At o min. ? _____________ 

At t» rnin. iu sec, ? At t> min. 44 sec. ? 

n. W hen does alpha first begin to go negative ? 

Assuming that the Light has progressed on profile, what shoulc. 
alp .i bt ^ ^ niin. ? At 6 min. ? At o min. 30 sec. ? 

8. Sketch the boost profile tor altitude on the chart provided. 

-. Sketch the flight display panel on Uic paper provided. Label the 

displays and indicate what are the primary and secondary (if 

applicable) dir-plays for the flight parameters associated with 

vehicle altitude and attitude. Where possible, indicate the scale 

o* o 

range for each instrument, i.e,, -5 to +40 . 
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